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ABSTRACT 


The  general  problem  treated  in  this  report  is  that  of  extracting 
structural  information  from  an  object  in  a scene.  In  particular, 
symmetries  are  used  as  another--in  addition  to  the  average  intensity 
values—global  coarse  picture  parameter  subregion  characteristic,  of 
a picture  that  has  been  regularly  decomposed  to  a dimensionally  reduced 
subset.  Regular  decomposition  is  a procedure  through  which  a picture 
is  subdivided  in  a particular  way,  leading  to  a data  structure  repre- 
sentation of  the  information  which  preserves  geometric  and  topological 
relationships  among  pixels  or  among  aggregates  of  pixels  (substructures) 
found  in  the  original  picture. 

A proposition  for  a recursive  algorithm  is  given  which,  when  applied 
to  a regularly  decomposed  picture  whose  important  information  is  kept 
in  a tree  data-structure,  specifies  the  tree  nodes  (i.e.,  picture  sub- 
regions  of  various  sizes)  that  must  be  paired  (or  compared)  to  identify 
(or  extract)  possible  symmetries  present  in  the  figure,  along  various 
directions . 
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SECTION  1 


INTRODUCTION 

The  general  problem  treated  in  this  report  is  that  of  extracting 
structural  information  from  a regularly  decomposed  picture. 

The  theme  of  this  report  is  that  the  key  to  effective  use  of  dig- 
ital computers  in  picture  processing  is  in  partitioning  before  applying 
local  techniques.  A characteristic  of  the  human  picture  analysis 
process  is  a hierarchical  type  of  functioning.  People  first  group 
data  in  perceptual  levels;  these  are  then  further  grouped  into  sub- 
divisions. Experiments  conducted  [ 42]  on  the  ways  we  describe  aerial 
terrain  photographs--or , in  general,  complex  pictures--concl uded  that: 
(1)  if  a picture  has  a central  theme,  we  respond  to  it  and  relate  other 
portions  to  it  and  (2)  if  a picture  has  no  central  theme,  but  is  to- 
tally diffuse,  we  partition  the  picture  into  quadrants  ("upper  right", 
"upper  left",  etc.)  and  either  describe  each  region  separately  or  the 
objects  within  the  quadrants  and  their  relationships.  The  analysis  of 
a complex  picture  by  computer  can  often  be  broken  down  into  two  steps 
I47J:  (a)  Discrimination  of  "uniform  regions"  within  the  picture  (a 

region  can  be  "uniform"  with  respect  to  values  of  any  of  several  local 
properties)  and  (b)  description  of  figures  within  the  picture  which 
can  be  built  up  out  of  these  regions. 

The  regular  decomposition  scheme  [2-3,  36-37]  of  the  next  section 
divides  a picture  into  subquadrants.  These  are  either  further  sub- 
divided or  discarded  according  to  the  amount  of  important  information 
they  contain. 

The  conjecture  C 18 J that  use  of  global  information  can  improve 
computer  analysis  of  pictures  (compared  with  blind  application  of  local 


— - — 1 

operators)  is  supported  by  results.  The  application  of  e local  cri- 
terion too  often  destroys  needed  information.  However,  the  main  problem 
encountered  in  the  global  methods  is  the  fact  that  the  search  space  is 
very  large,  tens  of  thousands  of  points  in  a picture,  and  the  combina- 
torics of  the  problem  force  unacceptably  long  search  times  [45].  There- 
fore, in  the  field  of  Artificial  Intelligence  much  research  has  been 
done  on  developing  heuristics  for  reducing  search. 

Regular  decomposition  is  a hierarchical  method  for  search  of  prac- 
tical representations  of  scenes  based  on  recursion  via  subblock  storage. 

Average  grey  level  intensity  over  the  cells  in  a given  subblock  is  used 
below  as  the  decision-driving  parameter.  Our  tree  structure  provides 
implicit  topological  relationships  among  the  picture  subquadrants.  At 
a specific  level  of  the  tree,  all  existing  entities  (for  brevity  we  use 
entity  to  mean  any  subquadrartt  retained  in  the  tree  representation  of  a 
picture)  are  uniform  in  size  and  shape.  The  tree  levels  give  implicit 
relationships  ("belongs  to"  or  "is  contained  in")  between  nonuniform 
entities : i.e.,  groups  of  subquadrants,  possibly  of  different  size. 

This  tree  data  structure  can  be  searched  and  picture  objects  retrieved 
by  processing  it. 

The  analysis  of  a difficult  problem  often  leads  to  the  discovery  of 
symmetries,  and  these  in  turn  lead  to  a simplification  of  the  problem. 
Simplification  of  problems  through  use  of  symmetries  can  be  viewed  as  an 

application  of  group  theory.  Symmetry  groups  are  a part  of  algebra  but 

they  also  relate  to  the  field  of  granhs.  Specifically,  they  permit 
identification  of  whether  a graph  is  invariant  under  rotations  and 
reflections.  Also  symmetries  are  us  id  in  games,  to  reduce  the  number  of 

distinct  decisions  to  be  made  or  movis  to  be  taken,  and  in  puzzles  to 

help  reduce  the  search  for  solutions. 

2 
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Natural  objects,  as  well  as  man-made  structures  and  symbols, 
frequently  possess  axes  of  symmetry.  An  elementary  example  of  pic- 
torial objects  divided  by  their  symmetry  properties  are  the  letters 
of  the  Roman  alphabet.  Polya  [1,  p.  89,  prob.  18]  noted  that  sub- 
sets with  horizontal,  vertical,  central,  all  three,  and  no  symmetries 
exist  within  the  twenty-six  letters.  Since  classifying  an  unknown 
image  pattern  by  a limited  series  of  measurements  is  a typical  pattern 
recognition  problem,  using  symmetry  data  aids  in  that  in  the  example 
of  alphabetic  characters  and  may  do  so  in  more  general  cases. 

In  order  to  use  symmetry  properties  in  computer  processing  of 
visual  data  (such  as  photographs  or  graphic  displays),  it  is  necessary 
to  develop  algorithms  to  evaluate  symmetries  in  two-dimensional  data 
sets  with  minimum  computational  effort.  This  report  is  an  initial 
investigation  of  the  theoretical  properties  which  underlie  such 
algorithms.  The  calculations  are  applied  to  the  area  of  pattern  per- 
ception by  automatic  means.  We  are  primarily  concerned  with  carrying 
the  regular  decomposition  procedure  into  structural  feature  identifi- 
cation and  extraction.  We  first  apply  the  regular  decomposition  scheme 
to  a picture  and  then  work  with  a dimensionally-reduced  data  base:  a 

structured  tree.  Our  goal  in  extracting  symmetry  data  from  general 
pictures  is  to  aid  registration  ("lining  up"  or  locating  of  key 
directions),  object,  location,  and  recognition.  We  are  trying  to:  iden- 

tify existing  relationships  between  tree  nodes  and  structural  features 
of  objects.  In  general,  structural  features  include  symmetry,  shape, 
perimeter,  straight  lines,  etc.  We  also  wish  to  derive  (optimum) 
algorithms  for  extracting  structural  information  from  the  tree  repre- 
sentation of  an  object  and  for  identifying  invariant  picture  substructures. 


Finally,  we  seek  to  define  "uniform"  regions,  where  uniformity  is  based 
not  only  on  intensity  but  also  on  the  structural  properties  of  an  object. 

The  results  are  set  forth  as  propositions  regarding  levels  within 
a grid  superimposed  on  a picture.  By  recursive  refinement  (deeper  levels 
are  found  in  finer  partitions  of  the  picture  region)  these  propositions 
can  be  applied  to  reduce  the  computing  time  needed  to  characterize  the 
symmetry  properties  of  a scene.  Results  obtained  include  the  identifi- 
cation of  tree  nodes  that  must  be  paired  (or  compared)  at  each  tree 
level  in  order  to  identify  (and  extract)  directional  symmetries  present 
in  a picture.  When  searching  the  tree  for  a certain  directional  symmetry, 
we  stop  examining  the  successors  to  a node  pair  if  that  pair  does  not 
belong  to  the  directional  symmetry  set  being  examined.  We  incorporate 
"no  move  to  next  level  if  the  examined  pair  of  nodes  is  not  a class  of 
the  examined  symmetry"  (successors  can  never  be  combined  to  yield  this 
symmetry  class  at  higher  resolution)  in  our  algorithms. 

The  initial  investigation  we  report  regards  only  four  directional 
symmetries:  horizontal,  vertical,  right  diagonal,  and  left  diagonal. 

We  propose  a recursive  algorithm  for  identifying  tree  nodes  corresponding 
to  these  four  directional  symmetries  at  various  degrees  of  picture 
resolutions  (or  tree  levels). 
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SECTION  2 

REGULAR  DECOMPOSITION  OF  PICTURES 
(AND  THEIR  TREE-REPRESENTATIONS) 

2.1  INTRODUCTION 

"Picture  digitization",  i.e.,  converting  the  two-dimensional 
analoq  signal  into  diqital,  oreceeds  any  application  of  diaital  com- 
puters to  picture  processing.  Digitized  pictures  are  two-dimensional 
arrays  of  "picture  elements"  (or  pixels)  similar  to  matrices.  Electro- 
optical  scanners  are  used  to  perform  this  analog-to-digital  conversion, 
and  each  pixel  is  an  average  of  local  light  intensity  in  the  picture 
around  a point.  This  average  intensity  is  usually  quantized,  for  real 
pictures  in  an  eight-level  quantization,  and  thus  the  digital  form  of 
a pixel  corresponds  to  an  8-bit  byte.  Through  the  most  oftenly  used 
"raster-scanner"  or  "flying  spot  scanner"  (although  as  we  will  see 
below,  other  types  of  picture  scanning  may  be  more  advantageous),  a 
picture  is  represented  as  a series  of  bytes  which  correspond  to  first 
row  leftmost  point. . .first  row  rightmost  point. .. second  row  leftmost 
...second  row  rightmost  ...  last  row  leftmost  ...  last  row  rightmost 
point.  In  this  "series  of  rows"  representation,  the  "points"  have 
a nonzero  diameter  given  by  the  optical  properties  of  the  scanner. 

The  "spread"  or  spot  size  and  averaging  characteristics  may  differ 
between  scanning  devices,  as  may  the  number  of  levels  of  quantization 
of  the  average  value  stored.  In  addition,  pixels  will  not  correspond 
exactly  to  the  same  points  or  spots  in  a picture  even  if  the  same 
scanner  is  used  twice  on  a given  image. 
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In  quantity,  a 500  row,  500  points  per  row  array,  or  briefly  a 
500  x 500  array,  would  rouqhly  correspond  to  a television  imane,  while 
pictures  of  real  scenes  (military  reconnaisance  data,  radar  multi- 
tarqet  data,  etc.)  are  of  size  1024  x 1024  points.  It  is  seen,  there- 
fore, that  we  are  talking  on  the  order  of  106  picture  elements  (or 
bytes),  and  in  trying  to  handle  them  by  computers  we  immediately  face 
the  storage  limitations  that  computer  central  memories  present.  The 
same  limitations  occur  in  processing  time  series  data  such  as  electro- 
cardiograms - where  events  of  similar  shape  occur  repeatedly  - or 
other  biomedical  applications  data,  such  as  x-rays,  chromosome  cells. 


A major  common  characteristic  of  such  pictures  is  the  fact  that 
not  all  these  sampled  data  convey  useful  information.  For  example, 
in  scenes  of  aerial  photographs  larqe  areas  of  the  nhoto  are  uniform, 
thus  being  of  little  or  no  importance.  In  time  series  data,  certain 
"regularities"  and  "repetitions"  exist  which  add  very  little  to  the 
total  useful  information.  In  processing  these  data,  little  or  no 
time  should  be  spent  looking  at  those  non  in formative  areas.  There- 
fore, the  key  problem  to  pattern  recognition  and  scene  analysis  is 
"data  reduction",  i.e.,  filtering  out  nonlnformati ve  areas  and  keeping 
only  the  more  complex  portion  of  the  data. 

Two  of  the  many  ways  by  which  this  can  be  done  are: 

(1)  by  structuring  the  data  according  to  goal-oriented  criteria 
(e.q.,  through  data  reduction  heurif.tics  designed  to  eliminate  parti- 
cular kinds  of  irrelevant  information),  and 
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(2)  by  subdividing  the  problem  into  smaller  and  easier-to- 
handle  subproblems  (e.g.,  by  ihstricting  the  problem  domain  to  a 
limited  number  of  possible  inputs). 

The  above  two  ways  are  not  necessarily  independent  of  one 
another.  All  problem  solving  activities  are  characterized  by  these 
properties  of  data  "over-richness"  and  problem  "over-complexity",  the 
first  requiring  search  procedures  for  identifying  useful  data  struc- 
ture formations,  the  second  involving  task  segmentation. 

Separation  of  "objects"  from  their  non informative  background 
has  long  been  a major  concern  in  pattern  recognition  and  scene  analy- 
sis [8-10].  Many  isolated  objects  present  in  a two-dimensional  array 
is  a characteristic  of  chromosome  data.  In  [11]  over  106  scanned 
elements,  from  more  than  forty  objects  in  one  picture,  were  first 

4 

reduced  to  some  10  data  points,  each  a left  or  right  end  point  of  an 
object  at  some  vertical  ordinate.  A similar  data  structure  is  pre- 
sented in  [123  where  a system  for  oicture  search  is  presented  which 
is  applicable  to  contour  maps  and  aerial  photographs.  Direct  object 
identification  was  also  done  algorithmically,  emnloying  edge  detec- 
tion and  line  fitting  procedures  [13-15]  while  others  have  performed 
extensive  analysis  relating  to  region  properties  (union,  intersection, 
common  boundary)  [16-19],  distance  properties  [12,  21],  chaininq  of 
boundary  points  [22]  and  subsequent  direct  identification  of  separate 
objects.  In  an  analogous  fashion,  Barrow  and  Milner  [25]  suggested 
a similar  approach  for  hierarchical  synthesis.  In  [26],  they  performed 
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a match  in  an  incremental  fashion  by  building  up  correspondences,  one 
pair  at  a time.  A partial  match  was  evaluated  by  determining  how  many 
of  the  relations  in  the  model  structure  agreed  with  their  correspond- 
ing picture  relations. 

All  these  techniques  have  the  major  disadvantage  of  investigat- 
ing long  tape  files  (i.e.,  exhaustive  point-by-point  search)  to 
determine  structural  properties  of  groups  of  pixels  or  to  identify 
objects  in  a scene  - a cumbersome  and  large-computer-time  consuming 
procedure.  Furthermore,  since  they  involve  a "bottom-up"  segmentation 
- the  use  of  raster  point  values  to  build  up  a more  global  picture 
description  - they  require  local  picture  processing  operations  first 
to  be  performed,  with  all  their  related  local  noise  influences  [16]. 
Thus,  the  trivial  cases  of  large  uniform-intensity  regions  (noninfor- 
mative  areas),  consume  an  unnecessarily  large  amount  of  computer  pro- 
cessing time. 

The  "top-down"  approach  of  regular  decompositions  of  two-dimen- 
sional arrays  (subdividing  the  problem  into  smaller  and  simpler  ones) 
has  been  independently  proposed  by  many  workers  in  computer  graphics 
(231,  scene  analysis,  architectural  design  C6]  and  pattern  recognition. 
Warnock  f 4 , 20J  used  successively  finer  squares  in  his  hidden-line- 
elimination  algorithm.  SRI's  mobile  automaton  r 5 1 utilizes  a "grid- 
model"  which  subdivides  the  automaton's  visual  environment  to  an 
arbitrary  degree  of  precision  for  determining  the  feasibility  of  a 
proposed  journey  path.  Many  others  have  also  followed  this  "de- 
composition-into-regions"  idea  as  a preprocessing  step  to  their 
analysis.  Barrow  and  Popplestone  [24]  were  first  converting  the  TV 
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picture  into  a set  of  regions  of  uniform  brightness  and  were  deter- 
mining properties  of  those  regions  (compactness,  trianqul arity)  and 
relations  between  them  (adjacency,  left  of).  Then  this  structure  of 
regions  with  given  properties  and  relations  was  in  turn  matched  aqainst 
standard  structures  previously  stored.  A similar  procedure  of  regu- 
lar decomposition  was  independently  proposed  in  [2]. 

The  advantage  of  the  decomposition  or  top-down  approach  is  that 
the  previous  extremely  local  raster  scan  representation  is  now  being 
replaced  by  a more  global  data-structure.  Furthermore,  this  way  of 
processing  pictorial  data  spends  little  or  no  time  looking  at  simple 
and  noninformative  areas.  Two  major  disadvantages  of  this  decomposi- 
tion are:  (1)  the  arbitariness  of  the  regular  decomposition  dividing 
lines  for  areas  and  (2)  the  decision  rule  whether  to  "partition 
farther".  The  two  ways  of  overcoming  these  disadvantages,  that  of 
using  neighboring  subquadrants  to  "soften"  the  regular  decomposition 
boundary  lines,  and  that  of  performing  adaptive  adjustment  of  para- 
meter threshold  values  will  be  discussed  in  a subsequent  section. 

Ways  of  incorporating  additional  subregion  characteristics,  besides 
just  average  subregion  intensity  values,  will  also  be  sugqested  in 
this  report. 

In  the  following  section  we  describe  the  regular-decomposition 
imaqe-processiing  algorithm  for  structuring  the  picture  data  and  ob- 
taining informative  or  complex  portions  of  a picture. 
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2.2  REGULAR  DECOMPOSITION  OF  PICTURES 
2.2.1  General 

There  are  many  ways  of  performing  the  two-dimensional  to 
one-dimensional  transformation  of  pictures,  the  raster  scan  or  line- 
by-line  digitization  and  serial  storage  being  the  simpler  and  most 
often  used.  It  is  also  well  known  that  a picture  array  can  be  thought 
of  as  a special  case  of  a tree-structure.  The  particular  equivalent 
tree-structure  depends  on  the  pixel  relationships  we  want  to  exemplify. 
For  example.  Fig.  2.2  represents  the  equivalent  tree-structure  of  the 
4x4  picture  of  Fig.  2.1  where  row  relationships  are  explicitly  shown, 
while  Fig.  2.3  represents  the  tree-structure  of  the  same  picture  where 
column  relationships  are  explicitly  shown. 
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2.1  : 

A 4 x 

4 Picture 
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Fig.  2.2:  The  Equivalent  Tree  of  Fig.  2.1,  Where 

Row  Relationship?  Are  Explicitly  Shown. 
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Fig.  2.3:  The  Equivalent  Tree  of  Fig.  2.1,  Where  Column 

Relationships  are  Explicitly  Shown. 


In  neither  of  the  two  tree  representations  however,  i.e., 
neither  in  the  series-of-rows  nor  in  the  series-of-col umns  representa- 
tions, are  the  geometric  relationships  among  pixels  preserved.  The 
particular  way  one  chooses  to  build  the  data  structure  reflects  the 
user's  priorities  about  the  accessibility  of  certain  properties  con- 
tained within  the  data  base,  and  the  above-mentioned  two  representations 

i 

yield  the  least  desirable  way  of  storing  and  accessing  the  picture  el- 
ements and  the  most  cumbersome  way  of  identifying  geometric  features  of 
objects  in  the  image.  Besides  these  horizontal  and  vertical  lines, 
there  are  many  other  straight  lines  (e.g.,  diagonal  lines)  or  line  seg- 
ments (e.g.,  lines  that  result  from  applying  edge  operators  like  the 
pseudogradient)  that  we  can  define  for  the  picture.  Important  aspects 
in  the  scene  analysis  procedure  are  line  interrelationships , line  densi- 
ties, etc.  Furthermore,  only  local  intensity  has  been  used  as  the  coarse 
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picture  parameter,  while  other  more  global  parameters,  features  (which 
are  aggregates  of  pixels)  and  relationships  may  be  better  (such  as 
average  region  intensity,  symmetry,  shape,  etc.).  Furthermore,  struc- 
tural or  syntactic  pattern  recognition  methods  [27-33]  present  serious 
limitations,  and  semantic-based  techniques  using  contextual  information 
should  be  also  used  [34].  Structuring  the  picture  by  regions,  instead 
of  by  individual  pixels,  and  labeling  the  nodes  of  the  new  tree  by  gross 
statistics  provides  information  for  accessing  regions  in  the  picture 
where  important  objects  are  found  [35]. 


2.2.2  Subquadrant  Tree  Structures 

Through  the  regular  decomposition,  the  equivalent  tree- 
structure  of  Fig.  2.1  is  given  in  Fig.  2.4.  The  entire  picture  array 
P has  four  subquadrants  Pa , Pb,  Pc,  and  Pd  and  this  tree  structure 
directly  reflects  area  coherence  rather  than  row  (Fig.  2.2)  or  column 
(Fig.  2.3)  coherence  [37]. 
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Fig.  2.4:  Tree-structure  Resulting  From  the  Regular 

Decomposition  of  a 4 x 4 Picture  Array  P. 
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4.  L_  4.  L. 

For  an  nxn  square  picture  P,  where  its  i row  jLn  column  elements  are 


denoted  by  P[i,j]t  i=l,2 n,  j=l,2,...,n,  then  the  four  subquadrants 

pa*  pb>  pc»  pd  are  given  by  [37]: 


pa  • {pci.j] 

Pb  - {PCi.jJ 

pc  -|p[i,j] 


pd  '(p[i,j] 


1 < i s 


(?+1) 

(?♦')* 


< i < n 


< i < n 


) 

(a*  l)  s j s nj 

) 


1 < i < - 
J 2 


(2.1) 


(i+  ’)s  n) 


In  [37]  a useful  method  is  given  for  locating  the  center  of  such  regular 
decomposition  regions.  Fig.  2.5  below  illustrates  this  quadrantization 
scheme  for  a single  level  of  decomposition. 


Equations  2.1  can  be  easily  carried  out  to  a second  level  of  decomposition 
as  follows: 


Informally,  a quadrant  is  a discrete,  rectangular  area  of  a picture 
characterized  in  terms  of  its  intensity,  relative  position  within  the 
picture,  and  its  size.  Hence,  for  implementation,  a quadrant  is  char- 
acterized by  a 5-tuple  of  characteristics  as  follows: 

C=  <Intensity,  x_min,  x_max,  y_min,  y_max>  (2.3) 


For  the  general  case,  the  quadrant  subdivision  is  done  by  dividing  each 
of  its  sides  in  half  and  then  assigning  the  appropriate  new  vertices  to 


each  subquadrant.  The  functions  floor  (LJ)  and  ceiling  (fl)  are  used 


so  as  to  make  the  boundary  lines  along  integer  positions  and  to  make  the 
four  resulting  subquadrants  disjoint  (Fig.  2.6).  These  are  defined  as 
follows: 


Yp  min  yp  max 


Fig.  2.6:  Integer  Boundary  Values  of  the  Four 

Subquadrants  of  Quadrant  P. 
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2.2.3  Methodology  of  Regular  Decomposition 

The  way  this  picture  decomposition  in  quadrants  is  being 
performed  is  as  follows  [2-3,  36-371: 

Initially,  the  entire  picture  two-dimensional  array  of  gray 
level  values  is  considered  as  a quadrant.  We  examine  the  whole  quadrant 
to  see  whether  there  is  anything informati ve  there.  The  two  critical 
issues  in  this  procedure  are:  (1)  to  define  an  "importance  factor"  for 

the  area  examined  which  will  give  a measure  of  "informativeness"  (this 
is  very  difficult  because,  in  the  general  case,  both  syntactic  and  se- 
mantic information  must  be  taken  into  account),  and  (2)  to  incorporate 
an  appropriate  discrimination  function  for  looking  into  further  details 
of  the  informative  area.  The  following  three  possible  cases  exist: 

1.  If  the  area  is  characterized  as  noninformative, 
then  that  area  of  the  picture  may  be  eliminated 
from  the  data  structure  without  significant  data 
loss.  Such  cases  are  for  example  large  homogeneous 
areas. 

2.  The  area  is  characterized  very  informative  (the 
discrimination  function  identifies  many  important 
features)  and,  therefore,  this  data  must  be  saved 
in  the  data  structure. 

3.  In  the  third  case,  the  area  is  characterized  with 
enough  importance  that  makes  us--at  least  so  far-- 
not  sure  on  whether  it  should  be  eliminated  from 

or  whether  it  shoulc  be  saved  in  the  data  structure. 

The  picture  must,  tierefore,  be  further  subdivided 
into  four  quadrants  and  ask  the  same  questions  about 
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each  one  of  these  fcur  subquadrants. 
16 


So  far  we  have  been  experimenting  using  only  intensities  as 
the  coarse  picture  parameter  and  obtaining  experimental  results  by  thresh- 
olding the  picture  using  various  threshold  values.  The  importance  of  any 
subquadrant  is  defined  relative  to  only  its  parent  quadrant.  The  relative 
importance  d(P,P*)  of  a subquadrant  P*  (where  * = a,b,c  or  d)  within  a 
quadrant  P is  defined  as: 

. / p p Intensity  of  subquadrant  P* 

^ ’ *'  Intensity  of  quadrant  P 

This,  d(P,P*)  represents  a percentage  of  information  relative  to  the  sur- 
rounding area,  and  this  function  is  convenient  since  it  is  independent  of 
depth  in  the  tree. 

The  picture  description  functioned)  =c^(d(P,P*))  is  defined 
as  the  importance  of  a quadrant  P*  in  picture  P.  The  following  is  an 

arbitrary  discrimination  function  using  threshold  values  0-j  and  0^  : 

(informative.  02  s d(P,P*)  < 1.0 

not  sure,  0j  s d(P,P*)  < 02 

non-informative,  0.0  < d(P,P*)  < 0^ 

Thus,  the  data-structure-creating  algorithm  is  as  follows: 

1.  Find  total  intensity. 

2.  Partition  into  four  subregions. 

3.  Refine  any  "not  sure"  subregion,  i.e.,  one  with 
intensity  greater  than  0-j  and  less  than  of 
the  one  higher  level  intensity. 

4.  Do  not  retain  any  "non-informative"  subregion,  i.e., 
one  with  intensity  less  than  0^  of  the  one  higher 
level  intensity. 
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5.  Stop  refining, when  an  "informative"  subregion,  i.e.. 


one  with  intensity  greater  than  0?  of  the  one  higher 
level  intensity. 

There  are  two  ways  of  actually  implementing  the  picture 
decomposition  into  its  tree  quadrants: 

[ 

The  first  way  corresponds  to  the  bottom-up  method,  operating 
on  long  "tape-files"  that  have  been  generated  by  a common  raster  scan 
procedure.  Therefore,  adaptation  and  processing  of  the  actual  sampled 
image  is  necessary.  This  is  done  by  bringing  into  main  core  a few  "line 
slices"  at  a time  and  processing  them  to  extract  all  the  useful  information 
for  the  tree  generation.  Quadrant  subpictures  represent  compact  areas  of 
picture  elements. 

The  second  way  corresponds  to  the  top-down  method,  assumes 
that  the  sequential  nature  of  tape  records  is  an  inappropriate  data 
structure  and  therefore  eliminates  the  conventional  raster  scan  techniques. 
Unconventional  scanning  equipment  could  be  built  to  retain  information 
about  neighboring  pixels  and  picture  quadrants  and  to  evaluate  local 
logical  functions  to  decide  which  are  ^ikely  structural  relationships. 

Data  could  be  obtained  by  logical  circuitry  clocking  performing  non- 
uniform  and  adaptive  picture  scans  under  computer  control  [38J.  This 
second  method  leads  directly  to  hardware  (processing  of  parallel  sensed 
picture  points)  T 39 T or  software  (parallel  picture  grammars)  [40] 
implementations. 

Details  of  overcoming  the  disadvantage  of  the  arbitrariness 
of  the  regular  decomposition  dividing  lines  through  the  notion  of 
"neighborhood  quadrants"  (i.e.,  "softening"  the  regular  decomposition 
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boundary  lines  through  heuristics  for  searching  neighborhood  quadrants 


for  added  linkage  information)  and  methods  of  merging  important  quadrants 


to  obtain  connected  areas  in  the  scene  in  terms  of  a specific  subtree. 


are  given  in  [36],  We  will  only  repeat  here  the  advantages  of  regular 


decomposition  as  stated  in  [36]: 


1.  Via  unconditional  partitioning,  pictures  which  are 


physically  too  big  to  store  in  fast  memory  at  one  time. 


can  be  processed  as  a sequence  of  subpictures  extracted 


during  preprocessing. 


2.  Regular  decomposition  enables  addressing  for  rapid 


access  to  any  geographical  part  of  the  image. 


3.  Regular  decomposition  retcins  explicitly  in  the  data 


structure  a hierarchical  description  of  picture 


patterns,  elements  and  their  relationships.  Hence, 


this  scheme  may  also  be  used  in  conjunction  with  syn- 


tactic pattern  recognition  algorithms  [41-44]. 


4.  Representations  permit  recursive  analysis  of  subpictures. 


5.  The  procedure  treats  all  picture  points  alike.  Hence, 


it  does  not  prefer  objects  with  any  directional  orienta- 


tion or  picture  location. 


6.  The  decomposition  algorithm  contains  major  routines 


(traversal,  tree-creation;  which  are  independent  of 


image  class.  Small  changes  can  adapt  regular  decomposi- 


tion to  widely  different  types  of  pictures. 


7.  The  resultant  tree  data  structure  distinguishes  object 


from  non  object  (or  background)  and  enables  processing  to 


locate  separate  objects. 
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SECTION  3 

BASIC  SYMMETRIES  AS  COMBINATION-CLASSES 
OF  THE  TREE'S  NODES 

3.1  INTRODUCTION 


In  this  section  we  present  the  relationships  between  directional 
symmetries  and  the  nodes  of  the  picture's  tree  representation.  Two 

★ 


grid  points,  lying  symnetrical ly  opposite  with  respect  to  a given  line, 

constitute  a "class"  denoted  as  S^  .(p  ),  where: 

1 


A : the  tree  level  at  which  these  grid  points  are 

found  (as  we  will  see  below), 
i : the  ith  "set",  to  which  all  classes  containing 

grid  points  that  lie  on  the  same  straight  line 
in  the  picture  array  belong, 
j : the  jth  class. 

p : the  direction  along  which  the  grid  points  lie  (i.e., 

along  a line  perpendicular  to  the  given  axis  of 
symmetry) . 

Each  of  the  above  mentioned  sets  is  denoted  as  s*(p  ) and  contains 
all  classes  S-  A p ) , j = l ,2 ,3 

* fj 


Our  initial  investigation  is  restricted  to  examining  classes  only  along 
the  following  principal  directions: 

1)  p = h : along  a horizontal  direction  (0°  or  180°),  where 

we  are  examining  grid  points  lying  symmetrically 
opposite  a vertical  line. 


★ 

Such  a line  corresponds  to  an  "ax  s of  symmetry",  and  the  two  grid 
points  of  a pair  are  equidistant  from  this  axis. 


2)  p = v : along  a vertical  direction  (90°  or  270°), 

where  we  are  examining  grid  points  lying 
symmetrically  opposite  an  horizontal  line. 


k.  1 < 


py~rw 


3)  p = r : along  the  direction  of  a right-diagonal 

line  (45°  or  225°),  where  we  are  examining 
grid  points  lying  symmetrically  opposite 
a left-diagonal  line. 

4)  p = l : along  the  direction  of  a left-diagonal 

line  (135°  or  315°),  where  we  are  examining 
grid  points  lying  sytmetrical ly  opposite  a 
right  diagonal  1 ine. 

In  the  general  case,  of  course,  we  may  define  more  directions,  thus 
establishing  larger  sets  of  such  directional  symmetry  classes. 

In  the  following  paragraphs,  we  present  ways  by  which  these  grid 
points  (given  as  nodes  of  the  corresponding  tree)  are  paired  to  define 
various  symmetry  classes,  along  the  above  mentioned  four  principal 
directions.  We  will  be  referring  to  square  grids  of  dimensions  2\  2*, 
where  A = l,2,3,...,n.  As  mentioned  before,  A also  denotes  the  tree 
level.  For  each  of  the  four  main  directions,  we  first  present  a detailed 
analysis  for  A = 1,2  and  3 and,  then,  generalize  for  the  case  A (i.e., 
for  2^  2^  grids) . 

3.2  HORIZONTAL  SYMMETRY  CLASSES  (p  = h) 

3.2.1  Grid  Size:  2x2  (i.e..  Level  One:  A = 1) 

At  this  level  1,  the  original  grid  P is  partitioned  into  the 
four  equal  subgrids  Pa>  Pb,  Pc,  P(j  of  figure  3.1a.  The  corresponding  tree 
structure  of  this  grid  is  shown  in  Figure  3.1b.  Each  subgrid  of  Figure 
3.1a  corresponds  to  a node  of  the  tree  at  level  1,  or  to  a "level-1  node". 
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abed 


Fig.  3.1:  Level  1.  (a)  The  2x2  Grid; 

(b)  Its  Tree  Representation. 


For  the  "horizontal  symmetry  classes"  (or  11  h- symmetry  classes",  or 
simply  "h-classes") , the  picture's  grid  points  are  paired  as  follows: 

(Pa  with  Pb)  and  (Pc  with  P^j 

This  is  shown  on  the  original  picture  as  the  shaded  squares 
of  Figure  3.2a,  and  on  its  tree  representation  as  the  solid  lines  of 
Figure  3.2b.  Following  our  notation,  each  such  pair  constitutes  a sym- 
metry class  denoted  by  sj  . (h),  where  the  subscript  i distinguishes 
among  the  various  sets,  and  the  subscript  j distinguishes  among  the  various 
classes. 

The  resulting  h-classes  are  given  (Figure  3.2c)  as: 


S!,l  <h>  ’ (Pa  • Pb) 
S2,l  <h>  ■ {Pc  ' Pd) 


(3.1) 


These  two  classes  correspond  to  the  two  sets: 


S1  (h)  = jsi,i  <h) 


s2  (h)  = S2,l  (h) 


(3.2) 


* 
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Sl,l^  S2,l^h^ 


Fig.  3.2:  Horizontal  Symmetry  Classes  at  Level  1.  (a) 

The  Paired  Grid  Points  (Shaded  Squares);  (b) 
The  Corresponding  Paired  Nodes  of  the  Tree 
(Solid  Lines);  (c)  The  h-classes. 


3.2.2  Grid  Size:  4x4  (i.e.t  Level  Two:  A = 2) 

At  this  level  2,  the  original  grid  P is  partitioned  into 

the  16  equal  subgrids  Paa>  Pflb Pdc,  Pdd  shown  in  Figure  3.3a. 

The  corresponding  tree  structure  of  this  grid  is  shown  in  Figure  3.3b. 
Each  subgrid  of  Figure  3.3a  corresponds  to  a node  of  the  tree  at  level 
2 or  to  a "level -2  node". 
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aa 
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Pba 

Pbb 

ac 
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Pbd 
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Pcb 
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level  1 


level  2 


Pa  p . P P . 
aa  ab  ac  ad 


P,  P 
be  ca 


Fig.  3.3:  Level  2.  (a)  The  4x4  Grid; 

(b)  Its  Tree  Representation. 


For  the  h-classes,  the  picture's  grid-points  are  paired 


as  follows: 


(Paa  with  Pbb)and  (Pab  with  Pba) 

(Pac  with  Pbd)and  (Pad  with  Pbc) 

(Pca  with  Pdb^and  (Pcb  with  Pda^ 

(pcc  wUh  Pdd)and  (pcd  with  Pdc) 

This  is  shown  as  the  shaded  squares  of  Figure  3.4a  or  the 
solid  lines  of  Figure  3.4b.  The  resulting  h-classes  are  given 
(Figure  3.4c)  as: 


2 

1,1 

(h)  = 

(Paa 

* Pbb\ 

and 

S2 

bl,2 

(h)  = 

hb 

, p 

2 

2,1 

(h)  = 

Kc 

» Pbd} 

and 

c2 

'2,2 

(h)  = 

hi 

, p 

2 

3,1 

(h)  = 

Ka 

’ Pdb} 

and 

<2 

'3,2 

(h)  - 

{Pcb 

• p 

2 

4,1 

(h)  = 

hc 

' Pdd\ 

and 

s2 

4,2 

(h)  = 

{Pcd 

• p, 

(3.3) 
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All  classes  with  equal  first  subscripts,  constitute  a set 
(in  this  case, an  h-set).  Thus,  from  Figure  3.4,  we  have  the  following 
four  h-sets: 


SV  h)  St  „(h) 


(h)  S‘  ,(h) 


//K'71 


s?(h) 


sf(h)  S^(h)  S^^h)  s‘(h) 


So(h)  O yT  y/ 

. S4 ,1 (h^  S4,2^h) 

“ " V 

s^(h) 


Fig.  3.4:  Horizontal  Symmetry  Classes  at  Level  2.  (a)  The 

Paired  Grid-points  (Shaded  Squares)  Which  Define 
Sets;  (b)  The  Corresponding  Paired  Nodes  of  the 
Tree  (Solid  Lines);  (c)  The  h-classes. 


3.2.3  Grid  Size:  8x8  h.e.,  Level  Three 


At  this  level,  the  original  grid  P is  partitioned  into  the 

64  equal  subgrids  Paaa>  paab,  > P^d  shorn  in  Figure  3.5a.  The 

corresponding  tree  structure  is  shown  in  Figure  3.5b,  where  its  termi- 
nal nodes  (leaves)  are  "level-3  nodes". 
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P sP 

aac  / Dbb 


level  1 


level  2 
level  3 


ccc  P 


PJ  A 

dda  dad 


Fig.  3.5:  Level  3.  (a)  The  8x8  Grid; 

(b)  Its  Tree  Representation. 

For  the  h-classes,  there  are  32  pairs  of  the  picture's  grid 
points  which  form  the  following  32  h-classes: 


l,l(h)"|Paaa,Pbbb} 

S?,2<h>s'(Paab-Pbba> 

S(,3<h>-,Pabb-Pbaa> 

S?,4<h>-'Paba'Pbab 

2,1 (h)={Paac,Pbbd} 

S2,2^h^={Paad,Pbbc} 

S2>3(h)={Pabd»Pbac} 

S3,3<h>-(PabCPbad 

3,l<h>'(Paca’Pbdb> 

S3,2^h^|Pacb,Pbda} 

S3,3<h>=,Padb’Pbca' 

53,4<h>=(Pada-Pbcb 

4,1  (h)={Pacc’[>bdd} 

S4,2<h>“(Pacd'Pbdc> 

S4,3<h>'(Padd'Pbcc» 

S4j4(h)={Pndc,Pbcd 

S,l<h>-(Pcaa-Pdbb> 

sl.2<h>-fPcab'pd;,a> 

55,3<hHPcbb-Pdaa' 

S5,4(h)={Pcba’Pdab 

6,1 (h)=lPcac,Pdbd] 

si,20o=(pcad,pdbc) 

Sl,3(h>='Pcbd-Pdac> 

SM<h>''PcbC-Pdad 

s?j2(b).{PCcb.Pdda' 

S).3(h>*lPcdb'Pdca' 

S7,4<h>-<Pcda’Pdcb 

8,l(">”(Pccc'Pbdd' 

SS,2(h>’tPccd'Pddc> 

S8,3^h^{Pcdd,Pdcc} 

S8,4(h^={Pcdc,Pdcd 

These  classes  form  the  following  eight  h-sets: 

S1  (h)  = {Sl,l  {h)  ’ Sl,2  (h)  » Sl,3  (h)  * Sl,4  (h)) 

s2  (h)  = {s|  i (h)  , S32>2  (h)  , S2>3  (h)  , S2j4  (h)}  (3.6) 

S8  ^ = {S8,l  ^ ’ S8,2  ^ ’ S8,3  ^ 5 S8,4 

These  eight  sets  are  shown  in  Figure  3.6  (shaded  squares).  Figure  3.7 
shows  the  respective  first  16  classes  which  correspond  to  the  top  four 
sets  of  Figure  3.6.  (The  pattern  of  node  combinations  in  Figure  4.7 
also  repeats  itself  for  the  right  most  32  nodes  of  the  tree.) 


\w//w//y//w/Ay/A 


\nr/,r/s/y//MY/y/A 


yaM'/My/M'/A'/A 


I ws//s//y/s//Y//y/sA  I 


\v/y//yy//y////y/s/A 


\Y/yy/<AYjY/y/jY/y//. 


XWMWtW&W/j 


V//y//y//syy///y///A 


Fig.  3.6:  Horizontal  Symmetry  Classes  at  Level  3.  The 

Shaded  Squares  Identify  the  Eight  Different 
Sets. 
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Fig.  3.7:  Horizontal  Symmetry  Classes  at  Level  3 as  Combinations  of  the  Tree  Nodes 
(The  Pattern  Repeats  Itself  for  the  Rightmost  32  Nodes  of  the  Tree.) 
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3.2.4  General  Case:  Grid  Size  2 ^ x 2^  (i.e.,  Level  A) 


At  this  level  X the  original  grid  P is  partitioned  into 

A a A 

2 ' x 2A  = 4 subgrids.  Each  such  subgrid  is  denoted  by  the  letter  F 
having  X letter-subscripts.  The  tree  representation  of  P has  (at 


level  A), 4'  nodes,  which  may  be  paired  to  form  p = ^ h-classes. 


These  p h-classes  form  k = 2^  sets,  aach  set  containing  t = 2 ^ 


classes: 


X 

S1 

(h)  = 

Ri 

(h)  . s(i2 

(h)  , ... 

s ^ 

• • al,t 

(h)} 

(h)  = 

iS2,l 

(h)  , S2>2 

(h)  , ... 

s^ 

• ’ z ,t 

(h)} 

< 

(h)  = 

ft.l 

(h)  , S^2 

(h)  , ... 

s ^ 

• ’ 5k,t 

(h)} 

VERTICAL  SYMMETRY 

CLASSES  ( jj 

= v) 

3.3.1 

Grid 

Size: 

2x2  (i.e.. 

-AjlJI 

The  2x2  grid  and  its  corresponding  tree  structure  were 
shown  in  Figure  3.1.  For  the  v-classes,  the  picture's  grid-points  are 
paired  as  follows: 


(pa  with  Pc)  and  (pb  with  Pd) 


Pb  with  Pd, 


This  is  shown  on  the  original  picture  as  the  shaded  squares  of  Figure 
3.8a  and  on  its  tree  representation  as  the  solid  lines  of  Figure  3.8b. 
The  resulting  v-classes  are  given  (Figure  3.8c)  as: 

S!,l  <''HPa  'Pc} 


s2,l  ’ K • p,l} 


(3.8) 
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These  two  classes  correspond  to  the  two  sets: 


f 


» 


sj  (v)  * 


s*  (v) 


(3.9) 


Fig.  3.8:  Vertical  Symmetry  Classes  at  Level  1.  (a)  The 

Paired  Grid  Points  (Shaded  Squares);  (b)  The 
Corresponding  Paired  Nodes  of  the  Tree  (Solid 
Lines);  (c)  The  v-classes. 


3.3.2  Grid  Size:  4x4  (i ,e. , X = 2) 

The  4x4  grid  and  its  tree  representation  are  the  same  as 
the  ones  shown  in  Figure  3.3.  For  the  v-classes,  the  picture's  grid- 
points  are  paired  as  follows: 


(paa  ",th  Pcc)  and  ('ac  “ith  pca) 

(Pab  ",th  Pcd)  and  ('ad  wfth  pcb) 

(Pba  w1th  Pdc)  and  ('be  w,th  pda) 

(Pbb  w,th  pdd)  and  ('bd  w1th  Pdb) 


1 


ii 


1 


I 

I 
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This  is  shown  as  the  shaded  squares  of  Figure  3.9a  or  the  solid  lines 
of  Figure  3.9b.  The  resulting  v-classes  are  given  (Figure  3.9c)  as: 
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1,1 

(v)  = 

Ip 

j aa  ’ 

p 1 
ccj 

and 

al,2 

(v)  = 

!PaC 

P 1 
ca( 

2 

2,1 

(v)  = 

Ip 

1 ab* 

Pcd| 

and 

5 2 ,2 

(v)  = 

lpad- 

P 1 
cbj 

2 

3,1 

(v)  = 

Ip 

lK  ba  ’ 

Pdc{ 

and 

s2 

a3,2 

(v)  = 

Ip 

I be  ’ 

P 1 
cial 

2 

4,1 

(v)  = 

Ip 

|p  bb' 

Pdd| 

and 

s2 

^4,2 

(v)  = 

1 p 

1 bd  * 

P 1 
ab  1 

These  classes  form  the  following  sets: 


Sj  (v) 
(v) 


s3  (V> 


s,2  (v) 


|S1,1  ’ S1 ,2  (v)) 

(S 2,1  ^ * S2,2 

jS3,l  (v)  ’ S3,2  (v)j 

|S4 ,1  (v)  ’ S4 ,2  (v)J 


(3.10) 


(3.11) 


1 


j 


<''>  = ,Paaa-Pccc> 

Sl,2(v)={Paac*Pcca> 

S(,3<v>‘(Pacc-Pcaa> 

S?,4(v)={Paca*Pcac} 

<''>*(Paab-Pccd> 

S23,2(vHPaad’Pccb> 

S2,3^'<Pacd'Pcab) 

S2,4(v^={Pacb,Pcad} 

<’'>-(Paba'Pcdc> 

S3,2(v)={Pabc*Pcda} 

S3.3<'')-fPadc-Pcba) 

S3,4^  = {Pada,Pcbc} 

l'''°,Pabb’Pcddt 

S4,2^v)={Pabd,Pcdb} 

S4.3<''l'lPadd-Pcbb) 

S4,4(v)={Padb,Pcbd; 

<’>=lPbaa-Pdcc> 

S5,2^  = {Pbac,Pdca} 

S5,3(''>'<Pbcc-Pdaa' 

SIUv)  = {Pbca’Pdac} 

*v*“<Pbab’Pdcd1 

S6,2^v^={Pbad,Pdcb} 

S6,3^=t:'bcd’Pdab! 

S6,4^v^{Pbcb,PdadJ 

<p>=(Pbba’PJdc) 

S7,2*v)={Pbbc,Pdda} 

S7,3*  v)=(Pbdc,Pdba-‘ 

s7>4(v)={pbda’pdbc} 

^='Pbbb’Pddd* 

S8,2(v)={Pbbd,Pddb} 

S8,3^v*=lPbdd,Pdbbi 

s3j4(v)  = {pbdb*pdbd1' 

(3.12) 

These  classes  form  the  following  eight  v-sets: 
.3  f..\  / ,,\  o3  / ..\  r>3  / 


4 (v) 
s23  (V) 


s8  <v> 


|S1,1  ^ ’ S1  >2  ^ ’ S1 ,3  ^ * Sl,4 

}S2 ,1  ^ ’ S2 ,2  ^ 5 S2,3  ^ » S2,4  (V>[ 

jS8,l  ^ * S8,2  ^ ’ S8,3  ^ ’ S8,4  ^ V^J 


(3.13) 


These  eight  sets  are  shown  in  Figure  3.10  (shaded  squares). 

3.3.4  General  Case:  Grid  Size  2^x  2*(i.e.,  Level  A) 

The  same  conclusions  apply  for  the  v-symmetries  as  for 
the  h-symmetries  of  paragraph  3.2.4.  The  v-classes  form  k=2A  sets, 
each  set  containing  t-2  ***  classes: 
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Fig.  3.10:  Vertical  Symmetry  Classes  at  Level  3. 

The  Shaded  Squares  Identify  the  Eight 
Different  Sets. 


S1  ^ = jSl,l  ^ * S1 ,2  ’ Sl,t 

s2  (v)  = js2Aa  (v)  , SA)2  (v), SAjt  (v)j  (3.14) 

sk  ^ = |Sk,l  ^ ’ Sk,2  ^ Sk,t 


3.4  RIGHT-DIAGONAL  SYMMETRY  CLASSES  (y=  r) 

3.4.1  Grid  Size:  2x2  (i ,e. , A = 1) 

For  the  r-classes,  the  picture's  grid-points  are  paired  as 

follows: 

(Pb  with  Pc) 


’ 

i 
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This  is  shown  in  Figure  3.11.  The  resulting  r-class  is: 


/ C/ 

(a) 


Fig.  3.11:  Riqht-diagonal  Symmetry  Class  at  Level  1. 

(a)  The  Paired  Grid-Points  (Shaded  Squares); 

(b)  The  Corresponding  Paired  Nodes  of  the 
Tree  (Solid  Lines);  (c)  The  r-class. 


This  class  corresponds  to  the  single  set: 

s}  (r)  = js}^  (r)j  (3. *6) 

3.4.2  Grid  Size:  4x4  (i.e.,  A = 2) 

For  the  r-classes,  the  picture's  grid-points  are  paired  as 

follows: 

(pbb  "ith  pcc)  and  (pbc  w,th  Pcb> 

(Pba  "tth  Pca) 

(pbd  "ith  pcd) 

r-classes  are: 

<r>  ■ !Pbb  • Pcc|  and  S(,2  <r>  * !pbc  ■ Pcb| 

<r>  ’ lPba  • Pca|  (3.17) 

<r>  * !Pbd  ' Pcd| 


The  resulting 
*1,1 


2,1 

2 

3,1 


3f> 


The  paired  grid-points  and  tree  nodes,  as  well  as  these 
four  r-classes,  are  shown  in  Figure  3.12. 


(b) 


(c) 


Fig.  3.12:  Richt-diagonal  Symmetry  Classes  at  Level  2. 

(a)  The  Paired  Grid-Points  (Shaded  Squares); 

(b)  The  Corresponding  Paired  Nodes  of  the 
Tree  (Solid  Lines);  (c)  The  r-classes. 


All  classes  with  equal  first  subscripts  constitute  a set  (in  this  case 
a r-set).  Thus,  from  Figure  3.12,  we  have  the  following  three  r-sets: 


3.18 


Fig.  3.13:  Right-diagonal  Symmetry  Classes  at  Level  3. 

The  Shaded  Squares  Identify  the  9 Different 
Sets. 


These  9 sets  are  shown  in  Figure  3.13  (shaded  squares) 

3.4.4  General  Case:  Grid  Size  2^x2^  (i.e..  Level  A 


At  this  level  A , the  original  grid  P is  partitioned  into 
4/  subgrids.  The  4 ^ nodes  of  the  tree  (at  level  A ) are  paired  to 
form  q'=  4A‘*  r-classes.  These  r-classes  form  k'  =3^*  sets: 

. sA  . , . , • The  number  of  classes  that  each  set  contains 

"l  * 2 * •••  9 I 

is  derived  as  follows: 

a)  For  A=  1,  there  exists  only  one  set  sj  (r),  containing  only 
one  class  sj  ^ (r) 
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b)  For  X > 1,  and  for  i = 1,  4,  7,  10,  13,  ...,  (k  -2): 

The  set  (r)  at  level  X,  contains  twice  as  many 
classes  as  the  set  s * * (r)  of  the  previous  level  A-l, 
where  a is  given  as:  a = (i+2)/3.  Each  one  of  the 

next  two  sets  at  this  level  X , s^+1  (r)  and  s?+2  (r), 
contains  half  as  many  classes  as  the  first  set  of  the 
level , s ^ (r) . 

The  following  Table  3.1  lists  the  number  of  classes  per 
set  per  tree  level  (for  the  first  four  levels). 

TABLE  3.1:  Number  of  Classes  Per  Set  Per  Tree  Level 

(For  the  First  Four  Levels) 


f«o.  of 

NO.  Of  j 

( lasse- 

classes 

Level 

Sets 

per  se‘ 

Level 

Sets 

per  set 

X-l 

... 

A*4 

S*(r) 

8 

i (k-i) 

si(r> 

s\(r) 

4 

X-2 

*f(r) 

2 

Sj(r) 

4 

k'-J) 

1 

4 

Sj(r) 

i 

s*(r) 

2 

A«3 

4 

2 

k'=9 

•!<'> 

2 

'W' 

4 

!?(r) 

2 

59tr> 

2 

2 

r ) 

2 

r 

4 

»|<r' 

i 

2 1 

2 

s?2<'> 

2 

sB(r> 

1 

2 | 

s|(r) 

1 

1 

1 

2 

*17,r| 

1 

‘l8<r' 

1 

4 

‘5o<'> 

2 

2 

2 

sZ3'r> 

1 

1 

'*slrl 

2 

'Uui 

1 

4 

'n[r) 
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3.5  LEFT-DIAGONAL  SYMMETRY  CLASSES  (y=  l) 
3.5.1  Grid  Size:  2x2  (i.e.,  a = 1) 


For  the  ^-classes  at  this  level,  the  picture's  grid-points 
are  paired  as  follows: 


(Pa  with  Pd) 


This  is  shown  in  Figure  3.14.  The  resulting  £-class  is: 


S 


1 

1,1 


00 


This  class  corresponds  to  the  single  £-set : 


s}  (0 


(3.21) 


(3.22) 


P P 


rrrr 

tv'/ 

/ 

VK 

Fig.  3.14:  Left-diagonal  Symmetry  Class  at  Level  1. 

(a)  The  Paired  Grid-points  (Shaded  Squares); 

(b)  The  Corresponding  Paired  Nodes  of  the 
Tree  (Solid  Lines);  (c)  The  £-class. 

3.5.2  Grid  Size:  4x4  (i.e.,  X = 2) 

For  the  H-classes  at  this  level,  the  picture's  grid-points 
are  paired  as  follows: 

(Paa  ",th  pdd)  and  hd  "1th  pda) 

(Pab  “ith  Pdb) 

(Pac  with  Pdc) 


_ . .. .. 
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The  above  four  classes  form  the  following  three  £-sets: 


U)  = js^j  (!)  , s^2  (oj 

s22  (0  * |s2jl  (i)J  (3.24) 

S 3 ^ jS3,l 


3.5.3  Grid  Size:  8x8  (i.e.,  A = 3) 

For  the  Jl-classes  at  this  level,  there  are  16  pairs  of 
the  picture's  points  (Figure  3.16)  forming  the  following  16  classes: 

^,1  ^apPaaa’Pdddj^l  ,2^=PPaad,Pdda^l  .S^^add^daa^l  ,4^=PPada’Pdad 
S2,l^;l*’Paab’Pddb)S2,2*Il',Padb,Pdab1 
S3,l<'>-(Paac-Pddc)S3,2<')=fPdac-Padc> 
S4i](0>!Paba,pdM)S^2(«)=,Pdba,Pabd) 

S5.l(t)='Pabb'Pdbb> 

S6,l<'>-,Pabc•Pdbc, 

^7,1  ^=^Paca,Pdcd^7,2^=PPacd’Pdca^ 

S8,l<'>'{Pacb-Pdcb> 

S9.1<J>-(Pacc-Pdcc> 


The  above  16  classes  make  up  the  following  9 sets: 


4 

U)  = 

L3 

11, 1 

(£)  ; 

S3 

’ *1,2 

(£)  , S 

4 

U)  = 

's3 

1*2,1 

U)  ■ 

S3 

* *2,2 

U)\ 

4 

U)  = 

L3 

<3,1 

U)  , 

S3 

1 *3,2 

(*)j 

4 

(l)  = 

(S3 

r4,i 

U)  , 

S3 

’ *4,2 

(A)j 

4 

U)  = 

's3 

1*5,1 

U)| 

4 

U)  = 

Ic3 

16,1 

(l)j 

4 

(i i)  = 

1-3 
r 7 , 1 

U)  , 

S3 

b7,2 

U)j 

4 

(0  = 

's3 

(8,1 

U)j 

4 

U)  = 

's3 

1*9,1 

U)j 

(3.26) 


P 
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These  9 sets  are  shown  in  Figure  3.16  (shaded  squares) 


Left-diagonal  Symmetry  Classes  at  Level  3. 
The  Shaded  Squares  Identify  the  9 Different 
Sets . 


3.5.4  General  Case:  Grid  Si^e  2 x 2 (i.e.,  Level  \ 


The  same  as  in  Paragraph  3.4.4  for  the  r-classes.  Table 
3.1  is  still  valid,  except  that  for  each  set, the  r is  being  replaced 


p 

"■! 

■ 

■|  • 

■ 1 

■ 1 

P 

S! 

■ 

8! 

■j 

■1 

SECTION  4 


IDENTIFICATION  OF  SYMMETRY  SETS  THROUGH 
A RECURSIVE  TRAVERSING  OF  THE  TREE 


4.1  INTRODUCTION 


The  analysis  of  the  previous  Section  clearly  shows  that  there 
are  certain  patterns  which  repeat  themselves  as  we  climb  down  the 
tree  (i.e.  increase  the  picture  resolution  by  looking  into  finer  de- 
tails). Furthermore,  these  patterns  remain  fixed,  and  unique  to 
the  examined  directional  symmetry. 

Formalizing  the  above  analysis,  we  present  in  this  section  a 
proposition  for  developing  a recursive  algorithm  for  systematically 
traversing  the  tree  data-structure  to  identify  directional  symmetries. 
The  results  obtained  include  the  identification  of  tree  nodes  that 
must  be  paired  (or  compared)  at  each  tree  level,  for  each  of  the 
above  mentioned  four  directional  symmetries. 

The  algorithm  is  checked  by  applying  it  to  the  same  structured 
data  of  the  previous  section.  The  results  - given  in  tabular  form, 
at  various  tree  levels,  for  each  of  the  four  symmetries  - are  the  same 
with  the  ones  obtained  with  the  analysis  of  Section  3. 

4.2  A PROPOSITION 


From  the  analysis  of  Section  3 we  can  now  derive  a recursive 
algorithm  for  identifying  the  tree  nodes  (grid  points  or  subregions 
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, /PFECJDIfG  'rApE  BLANK- NOT  FILMED 


I 
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of  the  picture)  that  are  paired  to  define  the  various  symmetry  classes, 
at  any  level  X of  the  picture  decomposition. 

Given  any  level  X-l,  let  sT-1  be  one  of  the  sets  at  this  level 
containing,  say,  p classes:  S^"-! , S^"i,  S^'l,  . ..,  . Each  class 

1,1  1,C  1,0  1,P 

links  two  nodes  at  level  X-l  of  the  picture's  tree  representation, 
7 f rn 

i.e,  the  class  is  defined  generally  as: 


A-l  = (X1 

i ,m  ) i,m’ 


(4.1) 


The  first  subscript  of  node  x corresponds  to  the  set  to  which 
this  class  belongs,  the  second  subscript  to  the  class  in  the  set,  and 
the  superscript  is  used  to  distinguish  between  the  two  nodes. 

From  the  results  of  the  previous  section  and  for  each  set  s^-1 , 
we  have  - at  the  next  higher  level  of  refinement  X - the  following: 

a)  For  horizontal  or  vertical  symmetries,  there  are  at  most  two 
new  sets 

s^  (•)  and  s*  (•) 

Y1  Y2 

where  the  subscripts  y-j  and  y ^ distinguish  between  the  two 
sets,  and  • stands  for  h or  u.  Furthermore,  each  such  set 
contains  t = 2^_1  classes,  as  pointed  out  in  paragraphs  3.2.4 
and  3.3.4. 

b)  For  right-diagonal  or  left-diagonal  symmetries,  there  are  at 

most  three  new  sets 

(•).  s)  (•)  and  s*  (•) 

Y1  y2  y3 

where  • stands  for  r or  e.  The  number  of  classes  that  each 
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! 

3 


1 

\ 


H 

9 
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set  contains  was  derived  in  paragraphs  3.4,4  and  3.5.4., 

Using  the  information  of  the  previous  level  X-l , we  can  easily  iden- 
tify what  will  the  forms  be  for  the  sets  and  classes  at  this  new 
level  of  refinement  X.  This  means  that  for  each  symmetry  type  we  can 
identify  the  paired  nodes  which  fcrin  the  respective  symmetry  classes, 
and  the  classes  that  make  up  the  various  sets. 

Each  class  belonging  to  these  "new"  sets  at  level  X,  has  the 
general  form 

su  - kA}  <4-2> 

i i 

i.e.  it  links  two  nodes,  wf^  and  w f^.  The  variables  w,  w , f ^ , and 
f£  are  defined  as  follows: 

I 

A)  The  variables  w and  w are  defined  using  the  data  available 
from  the  previous  level  X-l  and  take  on  the  foloowing  values: 

1 1 2 1 

' i,m’  l ,m  ( 

2 1 1 ( ^or  al 1 m = 1 • • »P 

and  i i ) w = x . , w = x . \ 

1'm  1*m  t (4.3) 


Therefore,  for  each  class  linking  at  the  previous  level 
1 2 

X-l  two  nodes  x.  and  x.  . two  new  different  classes  are 
i ,m  i ,m 

generated  at  the  next  higher  level  of  refinement  X,  having 
(from  eqs.  4.2  and  4.3)  the  forms: 


X \ 1 

, 2 

i ,1  ~ |Xi  ,m 

f 1 * xi,m 

A ( 2 

, 1 

i,2  ~ |xi  ,m 

fr  xi,m 
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B)  The  variables  f^  and  f,  take  on  different  values  according 
to  the  respective  symmetry  type  under  consideration.  For  the 
four  symmetries  we  have  the  following: 

Bl)  Fojr  !l- symme t r i e s^_ 

As  mentioned  above,  for  each  set  s'j~^(h)  of  the  previous 

level  A-l  there  are  at  most  two  new  sets  sX  (h)  and  s^  (h) 

Y1  y2 

at  the  new  level  A,  each  containing  t classes. 

Each  h-class  of  the  first  new  set  sA  (h)  has 

Y1 

f-|  = a and  f^  = b (4.6) 

and,  therefore  from  eq.  4.2,  its  general  form  becomes: 

.(h)  = {we,  w b}  for  all  m=l,2,...,p  (4.7) 

Yi  iJ 


On  the  other  hand,  each  h-class  of  the  second  new  set 

\ (h)  has 
y2 

f,  = c and  f2  - d (4.8) 


and,  therefore,  its  general  form  becomes: 


sv  i(h)  = {wc»  w 
!£  » J 


for  all  m=l ,2,, 


(4.9) 


B2)  Fojf  v/-£ynpetriesj_ 

Again,  there  are  at  most  two  new  sets  s^  (v ) and  s^  (v ) 

Y1  y2 

at  level  A,  each  containing  t classes.  Each  v-class  of 

the  first  new  set  (v ) has 
Y1 


f 1 = a and  ^2  ~ c 


(4.10) 
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and,  therefore,  its  general  form  becomes: 

S*  -(v)  = {wa,  w c}  for  all  m=l,2,...,p  (4.11) 

y-j 

Each  v-class  of  the  second  new  set  s^  (v ) has 

y2 

f -j  = b and  f2  = d (4.12) 

and,  therefore,  its  general  form  becomes: 

j(v)  = (wb,  w d}  for  all  m=l,2,...,p  (4.13) 

Y2»J 

B3)  Fo£  £_-syntnetr_ies± 

Here,  for  each  s^_1(r),  there  are  at  most  three  new  sets 

(r),  s^  (r),  and  s*  (r),  each  containing  the  number  of 
Y1  y2  y3 

classes  derived  in  Paragraph  3.4.4. 

Each  r-class  of  the  first  new  set  s^  (r)  has 

Y1 

f -j  = b and  f2  = c (4.14) 

and,  therefore,  its  general  form  becomes: 

i(r)  = (wb,  w c}  for  all  m=l,2,...,p  (4.15) 


Each  class  of  the  second  new  set  s^  (r)  has 

y2 

fl  = f2  = a 

and,  therefore,  its  general  form  becomes: 


(4.16) 


S*  .j(r)  13  (wa,  w a)  for  all  m=l,2,...,p  (4.17) 

*2,J 

Finally,  each  class  of  the  third  new  set  s^  (r)  has 

y3 


fl  = f2  = d 


(4.18) 


and,  therefore,  its  general  form  becomes: 


SA  .(r)  = {wd,  w dl  for  all  m=l,2,...,p  (4  19) 


B4)  For  symmetries^ 

Again,  there  are  at  most  three  new  sets  sX  (f, ),  sX  ) » 

X 1 2 

and  s (£),  each  containing  the  number  of  classes  derived 

y3 

in  Paragraph  3.5.4. 

Each  class  of  the  first  new  set  sA  (t)  has 

Y1 


f-j  = a and  ~ d 


(4.20) 


and,  therefore,  its  general  form  becomes: 

SX  ■ (?,)  = (wa,  w d)  for  all  m=l,2,a„.,p  (4.21) 


Each  class  of  the  second  new  set  sA  {i)  has 

y2 


fl  = f2  = b 


(4.22) 


and,  therefore,  its  general  form  becomes: 

S'*1  •(«,)  = (wb,  w b}  for  all  m=l,2,...,p  (4.23) 


Finally,  each  class  of  the  third  new  set  sA  {l)  has 

y3 


fl  = f2  = C 


(4.24) 


and,  therefore,  its  form  becomes 


SA  • (l ) = (wc,  w c}  for  all  m=l,2,.„..p  (4.25) 

Y3»J 

The  above  cases  B! , B2,  L'3,  B4  are  shown  graphically  in  Figure 
1.  For  example,  for  h-symmetries  the  values  that  f^  and  take  on 
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are,  (a  and  b)  or  (c  and  d);  for  .-symmetries  the  values  are  (a  and  d) 
or  (b  and  b)  or  (c  and  c),  etc. 


Fig.  4.1:  Graphical  Representation  of  the 

Values  that  fi  and  f2  Have  for 
the  Four  Different  Symmetries 
(h,v,r,i). 


4.3  EXAMPLES 


Using  the  above  proposition  we  now  give  a few  examples  for  the 
recursive  identification  of  the  classes  at  the  next  higher  level  of 
refinement. 


4.3.1  Level  1 (i.e. , A = 1 ) 

This  is  the  first  level  of  refinement,  where  a picture  P is 
decomposed  into  the  four  subpictures  Pa,  Pb,  Pc,  and  Pd,  and  from 
which  all  recursive  definitions  start.  At  level  X = 1,  there  are  at 
most  two  possible  sets,  each  containing  t = 1 symmetry-class.  There- 
fore, at  this  level,  a set  is  equivalent  to  a class,  having  the  gene- 


ral forms: 


s{(-)  = = jx] j , xi,i| 


(4.26) 
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and  sj(.)  S2j(»)  = jxJSj,  x| , 1 1 


For  h-syminetries  tiiese  two  sets  become: 


s](h)  - s|  j (h)  = jxjj,  x^j  = jpa,  Pbj 

s2(h)  = S2,l  (h)  = 'jx2,r  x2,lj  = jPc’  Pdj 

For  v- symmetries  these  two  sets  become: 

s-j(v)  = si  (v)  = jx]j,  Xjjj  = jpa,  Pcj 

s2(v)  = s2j(v)  = |x2 , 1 ’ x2 , 1 j = |Pb’  Pdf 

For  r-symmetries  there  is  one  set: 

sJ(r)  = sj  j (r)  = jxjj,  xij|  = JPb»  Pcj 
For  t-symmetries  there  is  also  one  set: 


(4.27) 


(4.28) 


(4.29) 


(4.30) 


(4.31) 


(4.32) 


sl(‘)  = s{  (*■)  |xi,t  xi,lj  = JPa’  Pdj  (4  33) 


4.3.2  Level  2 (i  .e. , X = 2) 

4 . 3 . 2 . 1 h-symmetn  es 

Using  the  data  available  at  the  previous  level  X = 1 (eqs.  4,28 

12  1 2 
and  4.29)  we  have  x^  ^ = Pa,  x^  ^ = Pb,  x^  ^ = Pc,  and  x2  -j  = Pd, 

which  will  be  used  to  identify  the  paired  tree  nodes  for  the  h-symme- 
try  classes  at  this  higher  level  of  refinement  X = 2. 

At  this  new  level  of  refinement,  from  the  proposition  of  Para- 
graph 4.2,  for  each  of  the  two  sets  sj(h)  and  s2(h)  of  eqs.  4.12  and 

2 2 

4.13  we  have  at  most  two  new  sets  s (h)  and  s (h),  each  containing 

Y1  y2 
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t = 2Z~^  = 2 classes. 

Using  the  proposition,  we  will  now  define  all  classes  (i,e.,  the 
pair  of  nodes  linked  by  each  class)  and  all  sets  (i.e.,  the  classes 
that  each  set  contains)  at  level  2 Since  there  are  two  sets  sj(h) 
and  s^(h)  at  the  previous  level  1,  our  procedure  is  subdivided  into 
two  parts:  one  starting  with  the  classes  of  the  first  set  s-j(h)  and 
the  other  starting  with  the  classes  of  the  second  set  s2(h). 

1)  Using  the  first  "old"  set  sj(h): 

From  eq.  4 28  the  "old"  set  contains  only  one  class  sj  ^(h) 
(second  column  of  Table  4.1a)  linking  the  two  nodes  Pa  and 
Pb.  Therefore,  xj  1 = Pa  and  -j  = Pb  (third  column  of 

I 

Table  4,1a).  The  variables  w and  w needed  to  identify  the 
classes  at  this  new  level  of  refinement  2 (see  eq  4,2) 
are  defined  from  eq.  4.3  as  shown  in  the  fourth  column  of 
Table  4 la.  At  the  present  level  of  refinement  X = 2, 


Table  4 la:  h-symmetry  Classes  at  X = 2. 

[Starting  with  sj (h)] 


Pre' 

nous  level  (A=l) 

Present  level  (X=2) 

Classes 
of  "old" 
set 

Mode 
pai  rs 

Variables 
w and  w1 

Classes  of  the  first 
"new"  set  sj(h): 

S?  ,(h)={wa,w'b} 

• *J 

Classes  of  the  second 
"new"  set  s|(h): 

So  ,(h)={wc,  w'd} 

£ * J 

x!,rPa 

1 , 2 
W"X1,T  w ~xl,l 

S^  1(h)={Paa,Pbb} 

SZ2  1(h)  = {Pac,Pbd} 

xi,rpb 

w=xl  ,1  ’ w'=xl  ,1 

S*  2(h)={Pba,Pab} 

S2  2(h)={Pbc,Pad} 
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there  are  at  most  two  "new"  sets  - denoted  as  s'j'(h)  and 
s ^ ( h ) - each  containing  two  classes  which,  from  the  propo- 
sition eqs  4.7  and  4.8,  will  have  the  respective  general 
forms : 

S^jth)  = (wa,  w'b)  , j = l ,2 
and  (4.34) 

.(h)  = (wc,  w dl  , j = l ,2 

I 

where  the  variable  w and  w are  defined  as  in  column  4 of 

Table  4.1a.  The  resulting  "new"  classes  at  the  present 

level  A - 2 are  given  in  the  fifth  and  sixth  columns  of 

Table  4.1a.  The  first  column  of  Table  4.1a  shows  all  the 

values  that  m takes,  i.e.  m = 1,  2,  . . , p.  Therefore, 

using  information  available  at  the  previous  level  X = 1, 

and  starting  with  the  first  "old"  set  sj(h)  we  have  defined 

2 2 

each  class  of  the  two  "new"  sets  s j ( h ) and  s^(h)  at  the 

present  level  A = 2, 

2)  Using  the  second  "old"  set  s^(h): 

From  eq.  4.29  the  "old"  set  contains  only  one  class  -|(h) 

(second  column  of  Table  4.1b)  linking  the  two  nodes  Pc  and 
1 2 

Pd.  Therefore,  ^ = Pc  and  x^  ^ = Pd  (third  column  of 

I 

Table  4. lb).  The  variables  w and  w are  defined  from 
eq.  4.3  as  shown  in  the  fourth  column  of  Table  4 lb.  The 
two  "new"  sets  of  the  present  level  A = 2 are  denoted  as 
Sj(h)  and  s^(h),  and  each  contains  two  classes  whose  gene- 
ral forms  are  as  in  eq.  4.34  above.  These  classes  are 


► 
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shown  in  the  fifth  and  sixth  columns  of  Table  4.1b. 

Table  4.1b:  h-symmetry  Classes  at  X = 2. 

[Starting  with  s2(h)] 


Previous  level  (X=l ) 

Present  level  (A=2) 

m 

Classes 
of  "old" 
set 

Node 
pai  rs 

Variables 
w and  w' 

Classes  of  the  first 
"new"  set  s3(h): 

S';  .(h)={wa,w'b} 

Classes  of  the  second 
"new"  set  s|(h) : 

s4  j(h)={wc , w'd) 

1 

S2 , 1 

x2,rPc 

w=x2 ,1 » w'=x2,l 

— — 

S3  -j (h)  = {Pca ,Pdb} 

S4  1(h)={Pcc,Pdd} 

x2,rpd 

w=xl ,1  * w’=x2,l 

S23  2(h)  = {Pda,Pcb} 

s4  2(h)={Pdc,Pcd} 

Thus,  for  the  h-symmetries  at  level  2,  we  have  the  following  four 
sets  of  classes: 

sl(h)  = {Sl,l(h)>  Sl,2(h)} 

s2(h)  = {S2,l(h)’  S2,2(h)} 
s3(h)  = |s3>1 (h) , S3j2(h)j 

54(h)  = {S4J  (h) » S2>2(h)}-  (4.35) 

Equation  4.35  is  the  same  as  eq.  3.4  of  Section  3.  The  classes  in 
eq.  4.35  are  as  defined  in  Tables  4.1a  and  4.1b,  and  they  are  the 
same  as  in  eq.  3.3  of  the  previous  section. 
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4 . 3 . 2 . 2 v-symmet r i e s 

We  will  use  the  proposition  of  Paragraph  4,2  and  a procedure 
analogous  to  the  one  of  tne  above  Section  4.3.2. 1 in  order  to  identify 
the  v-classes  at  the  present  level  X = 2.  Again,  we  will  start  sepa- 
rately for  each  of  the  two  "old"  sets  sj (v)  and  s^(v). 

1)  Using  the  first  "old"  set  sj(v): 

From  eq.  4.30,  the  "old"  set  contains  only  the  class  sj  | (v ) 

(second  column  of  Table  4 2a)  which  links  the  two  nodes 

1 2 

Pa  and  Pc.  Therefore,  x-j  ^ = Pa  and  x-j  ^ = Pc  (third  co- 
lumn of  Table  4.2a)  The  two  "new"  sets  of  the  present 
level  A = 2 are  denoted  as  s-j(v)  and  s^(v)  and  each  con- 
tains two  classes  which  - from  the  proposition  eqs.  4.11 


Table  4 2a:  v-symmetry  Classes  at  k = 2. 

[Starting  with  s|(v)j 


Previous  level  (X=l) 

Present  level  (X=2) 

| 

Classes 
J m of  "old" 
j set 

Node 
pai  rs 

Variables 
w and  w' 

Classes  of  the  first 
"new"  set  sij(v) : 

S?  .(v)={wa,w' c} 

* 9 J 

Classes  of  the  second 
"new"  set  s^(v) 

5^  j (v  ) = {wb  ,w'd) 

r~f 

i|  si  i(v> 

1 1 

xi,rPa 

S2  ^(v )={Paa,Pcc} 

S2  ](v)={Pab,Pcd} 

X2  =Pc 
xl,l  c 

w=xl,l’  w'-xj^ 

S2  2(v  )=(Pca  ,Pac} 

S2  2(v)  = {Pcb,Pad} 

and  4.13  - have  the  general  forms: 

S2  ■ (v)  = (wa,  w c} , j=l  ,2 
and  (4.36) 

S^j(v)  = {wb,  w ' d } , j = 1 , 2 
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The  resulting  "new"  classes  at  the  present  level  X = 2 are 

given  in  the  fifth  and  sixth  columns  of  Table  4.2a. 

2)  Using  the  second  "old"  set  s^v): 

From  eq.  4.31  the  "old"  set  contains  the  class  ^ (v ) 

(second  column  of  Table  4.2b)  which  links  the  two  nodes 

1 2 

Pb  and  Pd.  Therefore,  *2  -|  = Pb  and  x2  1 = Pd  (third  co- 
lumn of  Table  4.2b).  The  two  "new"  sets  of  the  present 


Table  4.2b:  v-symmetry  Classes  at  X = 2. 

[Starting  with  s2(v)] 




Previous  level  (X=l) 

Present  level  (X=2) 

m 

Classes 
of  "old" 
set 

— 

Node 

pairs 

Variables 
w and  w' 

Classes  of  the  first 
"new"  set  s^( v) : 

S$  .( v)={wa,w‘c} 

^ f J 

Classes  of  the  second 
"new"  set  s^(v): 

s4,j( v)={wb,w,d} 

1 

s2j(v) 

x2,rPb 

w=x2 , i * w‘ =xi,i 

S3  1(v)={Pba,Pdc} 

S4J  ( v)={Pbb,Pdd) 

-2,rPd 

w=x2 ,1 » w=x2,l 

S3>2(v)={Pda,Pbc} 

S^UHPdb.Pbd} 

2 2 

level  2 are  denoted  as  s^(v)  and  s^(v),  and  each  contains 
two  classes  whose  general  forms  are  as  in  eq.  4.36  above. 
These  classes  are  listed  in  the  fifth  and  sixth  columns 
of  Table  4.2b. 

Thus,  for  the  v-symmetries  at  level  2,  we  have  the  following  four 
sets  of  classes: 

sl^  = {Sl,l(v)’  Sl,2^} 

S2(v)  = {S2,l(v)*  S2,2(v)} 
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s3(v)  ■ sm 

s,(v)  = {s| _ , ( v ) . S^>2(v)}  (4.37) 

Equation  4.37  is  the  same  as  eq.  3.11.  The  classes  in  eq.  4.37  are 
as  defined  in  Tables  4.2a  and  4.2b,  and  they  are  the  same  as  in  eq. 
3.10. 


4 . 3 . 2 . 3 £- symm^t  n e s 

From  eq.  4.32  there  is  only  one  "old"  set  at  the  previous  level 
X = 1,  containing  only  one  class  s]  j(r)  (second  column  of  Table  4.3) 
linking  the  two  nodes  Pb  and  Pc.  From  the  proposition  of  Paragraph 
4.2,  we  see  that,  at  this  new  higher  level  of  refinement  X = 2,  there 


Table  4.3:  r-symmetry  Classes  at  X = 2. 


Previous  level  (A=l) 

Present  level  (X=2) 

p 

m 

Classes 
of  "old" 
set 

Node 

pairs 

Variables 
w and  w' 

Classes  of  the  first 
"new"  set  sj!r): 

S';  .(r)={wb,w’c) 

Classes  of  the  second 
"new"  set  sz(r): 

Sz  .(r)=(wa,w’aj 

Classes  of  the  third 
“new"  set  s|(r): 

S?  .(r)={wd,w'd) 

£ » J ___ _ 

—— 

xl,rPb 

1 . 2 
w=xi,rw  "xi,i 

S*  ^(r)=!Pbb ,Pcc) 

Sz  ^rWPba.Pca) 

s\  ^ ( r)=<Pbd .Pcd) 

i 

xi.rPc 

2 , J 

w=xl,l,w  =xl,l 

SP  z(r)*{ Pcb.Pbc) 

2 2 2 

are  at  most  three  "new"  sets  s-|(r),  s2(r),  and  s3(r).  The  number  of 
classes  that  each  new  set  contains  was  derived  in  Paragraph  3.4.4. 

In  this  case,  the  first  new  set  contains  two  classes,  while  the  other 
two  new  sets  each  contains  only  one  class.  From  eqs.  4.15,  4.17  and 
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4.19,  the  classes 

of  the  respective  three 

new  sets 

have  the  following 

forms : 

S?  .-(r)  = (wb,  w c)  , 

j=l,2 

2 ' 

S9  - (r ) = {wa,  w a)  , 

j=l 

(4.38) 

and 

S3<j(r)  = {wd,  w d)  , 

j=l 

The  resulting  "new"  classes  at  the  present  level  X=  2 are  given  in 
the  fifth,  sixth  and  seventh  columns  of  Table  4.3. 


Thus,  for  the  r-symmetries  at  level  2,  we  have  the  following  three 
sets  of  classes: 

sf(r)  = {S^tl(r),  S^2(r)} 

sf(r)  = {S2,l(r)}  (4-39) 

s3(r)  = {S3>1(r)} 

Equation  4.39  is  the  same  as  eq.  3.18.  The  classes  in  eq.  4.39  are 
listed  in  Table  4.3  and  they  are  the  same  as  in  eq.  3.17. 

4 . 3. 2 . 4 Z-symetnes 

From  eq.  4.33  there  is  only  one  "old"  set  containing  the  class 
sj  i (Z) ( second  column  of  Table  4.4)  which  links  the  two  nodes  Pa  and 
Pd.  From  the  proposition  we  see  that,  at  this  new  higher  level  of 
refinement  \=  2,  there  are  again  at  most  three  "new"  sets,  denoted  as 
s^U),  s£U),  and  s 3U).  The  number  of  classes  that  each  new  set 
contains  was  derived  In  paragraph  3.5.4.  Again,  the  first  new  set 
contains  two  classes,  while  the  otaer  two  new  sets  each  contain  only 
one  class.  From  eqs.  4.21,  4.23,  and  4.25  the  classes  of  the  respective 


three  new  sets  have  the  following  forms: 

S?  ,(«.)  = (wa,  w d],  j=l ,2 
* 

si  -(£)  = {wb,  wb},  j=l 

C 9 J 

2 1 

and  .(«.)  = {wc,  w c>,  j=l 

^ 9 J 


(4.40) 


The  resulting  "new"  classes  at  the  present  level  A = 2 are  given  in 
the  fifth,  sixth,  and  seventh  columns  of  Table  4.4. 


Table  4.4:  ^-symmetry  classes  at  A = 2 


Thus,  for  the  ^.-symmetries  at  level  2,  we  have  the  following  three  sets 


of  classes : 


(4.41) 


Equation  4.41  is  the  same  as  eq.  3.24.  The  classes  in  eq.  4.41  are 
listed  in  Table  4.4  and  they  are  the  same  as  in  eq.  3.23. 


- , 


Previous  level  (a=1) 
Classes 

of  "old"  Node  [Variables 
set  oai rs  w and  w' 


Present  level  (A=2) 

Classes  of  the  first  Classes  of  the  second  Classes  of  the  third 
"new"  set  s^(l):  "new"  set  s|(S.):  "new"  set  s^U): 

St  ,(t)*(wa,w,d}  St  . I L l^lwb .w ' b i S.  . ( V 1 = < wr _w 1 r 1 


s^fl(e)*{Paa,Pd<l)  S^jUMPab.Pdb)  | s|  ,(t)  = !Pac.Pdc) 
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4.3.3  Level  3 (i .e.  A = 3) 

4 . 3 . 3 . 1 h_-syrnmet_ri  e s 

From  eq.  4.35  we  see  that  at  the  previous  level  A"  2 there  were 

four  different  sets  s^h),  s^h),  s3(h),  and  s^(h).  Therefore,  our 

procedure  here  is  subdivided  into  four  parts,  each  part  starting  with 

the  classes  of  one  of  the  above  four  sets.  Again,  at  this  new  level 

of  refinement,  we  have  for  each  "old"  set  at  most  two  "new"  sets,  each 
3-1 

containing  t=2  = 4 classes.  Our  procedure  for  identifying  the  classes 
at  level  3 is  as  follows: 

1)  Using  the  first  "old"  set  s^(h): 

2 

From  eq.  4.35  the  "old"  set  contains  two  classes  -](h) 

2 

and  S-|  2(h)*  as  shown  in  the  second  column  of  Table  4.5a. 

The  first  class  links  the  two  nodes  Paa  and  Pbb,  while  the 

second  links  the  two  nodes  Pba  and  Pab.  Therefore, 

12  1 2 
x-j  ^ = Paa  , j = Pbb  , x-j  2 = p,3a  anc*  xi  2 = Pab’  as 

listed  in  the  third  column  of  Table  4.5a.  The  fourth 

column  of  Table  4.5a  lists  the  values  of  the  variables  w 

I 

and  w as  they  are  defined  in  eq.  4.3. 

At  the  present  level  of  refinement  A = 3,  there  are 

3 3 

at  most  two  "new"  sets--denoted  as  s^(h)  and  S2(h)--each 
containing  four  classes  which,  from  the  proposition  eqs. 

4.7  and  4.8,  have  the  general  forms: 

3 3 1 

the  classes  of  the  s,(h):  S,  -(h)  = (wa,  w b } , j=l,2,3,4 

l,J  (4.42) 

3 3 

the  classes  of  the  S2(h):  j ( h ) = {wc,  w'd],  j = l ,2,3,4 
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Table  4.5a:  h-symmetry  classes  at  X = 3.  [Starting  with  s^(h)] 


Classes 

m of  "old"  Node 
set  pairs 


S1  l(h)  2 

xi,rF 


xi ,2'f 
..2  _r 


o c2  /ux  1,2 

2 Sli2(h)  ’ 


1 (X=2) 

Present  level  (X=3) 

Vari ables 
w and  w1 

Classes  of  the  first 
"new"  set  s|(h) : 

Si  •(h)={wa,w'b} 

Classes  of  the  second 

"new"  set  s~(h): 
c 

s'  .(h)={wc,w'd} 

» J 

”=x!,r 

-|(h)  = {Paaa,Pbbb} 

s'  1(h)={Paac,Pbbd) 

"*xi,r 

s'  ?(h)  = {Pbba ,Paab} 

S^  2(h)=(Pbbc,Paad} 

w=xl,2*  w'=xl,2 

s'  3(h)  = {Pbaa ,Pabb} 

s'  3(h)={Pbac,Pabd} 

w=xl,2’  w=xl ,2 

s'  4(h)={Paba  ,Pbab} 

S3  4(h)={Pabc,Pbad} 

where  the  values  of  w and  w are  given  in  the  fourth  column 

of  Table  4.5a.  The  resulting  "new"  classes  at  the  present 

level  X = 3 are  given  in  the  fifth  and  sixth  column  of  Table 

4.5a.  In  this  case,  m takes  on  the  values  1 and  2,  as  shown 

in  the  first  column  of  the  table. 

2)  Using  the  second  "old"  set  s^Ch): 

Again,  from  eq.  4.35  the  "old"  set  contains  two  classes 
2 2 

-|(h)  and  2(h)*  as  shown  in  the  second  column  of 
Table  4.5b.  The  first  class  links  the  two  nodes  Pac  and  Pbd, 

while  the  second  links  the  two  nodes  Pbc  and  Pad.  Therefore, 

12  1 2 
X2  ^ = Pac,  y~2  1 = Pbd,  *2  2 = pt)c,  and  x2  2 = Pad’  as  '*'istecl 


in  the  third  column  of  Table  4.5b. 


Table  4.5b:  h-symmetry  classes  at  X = 3.  I Starting  with  s^h)]. 


Previous  level  (A=2) 


Classes 
m of  "old 


Variables 
w and  w' 


Present  level  (A=3) 


Classes  of  the  first  Classes  of  the  second 
"new"  set  s3(h):  "new"  set  s^(h): 


1 12 
x^  i=Pac  w=x^  ^ , w1 =x^ 

So  I (h)  / 

X^  T=Pbd 


2 S|§2(h) 


2 1 
w=x9  0,  w'=x0 


S3  1(h)={Paca,Pbdb} 

■■■  ■ ■■-  - =■ 

S3  1(h)={Pacc,Pbdd) 

S33  2(h )-{Pbda ,Pacb} 

„(h)={Pbdc,Pacd} 

* £ 

S3  3(h)={Pbca,Padb} 

S3 

*4 

3(h)={Pbcc,Padd) 

S3  4(h)={Pada ,Pbcb} 

^(h)={Padc,Pbcd} 

The  variables  w and  w are  defined  from  eq.  4.3  and  have  the 
values  listed  in  the  fourth  column  of  the  Table.  The  two 
"new"  sets  of  the  present  level  A = 3 are  deno:ed  as  s^(h)  and 
s^(h),  and  each  contains  four  classes  whose  general  forms  are 
as  in  eq.  4.42  above.  These  classes  are  shown  in  the  fifth  and 
sixth  columns  of  Table  4.5b. 

3)  Using  the  third  "old"  set  s3(h): 

2 2 

Again,  the  "old"  set  contains  two  classes  S3  •j(h)  and  S3  3(h) 

as  shown  in  the  second  column  of  Table  4.5c.  The  first  class 

links  the  two  nodes  Pea  and  Pdb,  while  the  second  links  the  two 

1 2 

nodes  Pda  and  Pcb.  Therefore,  x^  ^ = Pea  , -j  = Pdb  , 

1 > 

2 = Pc*a  ♦ and  x*  2 = Pcb’  as  ^1stecl  in  the  third  column  of 
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Prev 

ious  leve 

(X=2) 

Present  level  (A=3) 

m 

Classes 
of  "old" 
set 

Mode 
pai  rs 

Variables 
w and  w‘ 

Classes  of  the  first 
"new"  set  s|(h ) : 

sl  .(h)={wa,w'b> 

3 » J 

Classes  of  the  second 
"new"  set  Sg(h): 

sj  .(h)={wc,w' d} 

1 

S3,l<h> 

x3,rPca 

m 

Sg  1(h)={Pcac,Pdbd} 

1 

4,1=“ 

w x 3 , 1 * 

w=x3,l 

Sg  2^ ) = ^Pdba ,Pcab} 

sl  o(h)={Pdbc ,Pcad } 
6,2 

n 

s3j2(h) 

x3,2=Pda 

w=x3,2’ 

BB 

Sg  30,)  = {Pdaa,Pcbb} 

Sg  3(h)={Pdac,Pcbd) 

2 

x3,2=Pcb 

Sg  4(h)={Pcba,Pdab} 

Sg  4(h)={Pcbc,Pdad} 

Ik 


Table  4.5c.  The  variables  w and  w are  defined  as  in  the 

fourth  column  of  the  Table.  The  two  "new"  sets  of  the 

3 3 

present  level  A=  3 are  denoted  as  Sg(h)  and  Sg(h),  and 
each  contains  four  classes  whose  general  forms  are  again 
as  in  eq.  4.42  above.  These  classes  are  shown  in  the 
fifth  and  sixth  columns  of  Table  4.5c. 

4)  Using  the  fourth  "old"  set  s^(h): 

Again,  the  "old"  set  contains  two  classes  S4  ^(h)  and 

p 

S4  2(h)  as  shown  in  the  second  column  of  Table  4.5d. 

The  first  class  links  the  two  nodes  Pcc  and  Pdd,  while 
the  second  links  the  two  nodes  Pdc  and  Pcd.  Therefore, 

- Pcc  , x4  ^ - Pdd  , x^  2 = Pdc  , and  x4  2 — Pcd, 

as  listed  in  the  third  column  of  Table  4.5d.  The 


•1 


66 


M 


Table  4.5d:  h-symmer.ry  classes  at  A = 3.  [Starting  with  s4(h)] 

Previous  level  (A=2)  Present  level  (A=3) 


Classes 

m of  "old"  Node 


Variables 


set  pairs  w and  w1 


1 sft,(h)  ' 


Present  level  (A=3) 

Classes  of  the  first  Classes  of  the  second 
"new"  set  Sy(h):  "new"  set  Sg(h): 

^7  i(h)={wa,w'b}  S l .(h)={wc,w'd} 

/ »J  o»J __ 


2 S4>2(h)  „ 


=Pcc 

w=x4,l’  w'=x4,l 

S3  1 (h)={Pcca,Pddb} 

S3  1(h)={Pccc,Pddd} 

=Pdd 

w=x4,l ’ W'=X4,1 

S3  2(h)={Pdda,Pccb} 

Sg  2(h)={Pddc,Pccd} 

= Pdc 

w=x4,2*  w'”x4,2 

$7  g(h)={Pdca ,Pcdb} 

Sg  g(h)={Pdcc,Pcdd} 

=Pcd 

w=x4,2*  w'=x4,2 

S3  .(h)  = {Pcda ,Pdcbl 

Sg>4(h)={Pcdc,Pdcd} 

variables  w and  w are  defined  as  in  the  fourth  column 

of  the  Table.  The  two  "new"  sets  of  the  present  level 

3 3 

A = 3 are  denoted  as  s^ ( h ) and  sg(h),  and  each  contains 
four  classes  whose  general  forms  are  again  as  in  eq.  4.42 
above.  These  classes  are  shown  in  the  fifth  and  sixth 
columns  of  Table  4.5d. 

Thus,  for  the  h-symmetries  at  level  3,  we  have  the  following  eight 
sets  of  classes: 


s|(h)  = 

= {S3 

lbl  ,1 

(h). 

s^2(h), 

S3 

3(h) , 

S3 

1, 

,4(h» 

s|(h)  = 

. (s3 
tb2,l 

(h). 

S2>2(h), 

S3 

b2, 

3(h) , 

S3 

*2, 

Sg(h)  = 

. {s3 
lb3,l 

(h), 

s3>2^h), 

S3 

b3, 

3(h) , 

*s. 

,4<h» 

54(h)  ■ 

: (S3 

lb4,l 

(h). 

S4,2 

S3 

b4, 

3(h), 

< 

i4(h)> 

s5(h)  = 

: 

lb5,l 

(h). 

S5 ,2  * 

S3 

b5, 

3(h) , 

s3 

*5, 

i4(h)l 

s>)  ■ 

: (S3 
li6,l 

(h), 

se,2  h^‘ 

S3 

*6, 

3(h) , 

S3 

0, 

4(h» 

S;(h)  1 

: (S3 

1:>7,1 

00. 

S7 ,2 

S3 

b7, 

3(h), 

S3 

b7, 

,4<h» 

s|(h)  . 

: (S3 

*8,1 

(h). 

S8,2  h^’ 

S3 

8, 

3(h), 

S3 

8, 

.♦(*» 
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(4.43) 


Equation  4.43  is  the  same  as  eq.  3.6  of  the  previous  Section  3. 
The  classes  in  eq.  4.43  are  as  defined  in  Tables  4.5a,  4.5b,  4.5c, 
and  4.5d,  and  they  are  the  same  as  in  eq.  3.5. 

4 . 3 . 3 . 2 v - symme  t r_i  £S 

From  eq.  4.37  we  see  that  at  the  previous  level  A = 2 there  were 
2 2 2 2 

four  different  sets  s^(v),  s^v),  s^v),  and  s^(v).  Therefore,  again 

our  procedure  is  subdivided  into  four  parts,  one  part  for  the  classes 

of  each  of  the  above  four  sets.  For  each  "old"  set  we  have  at  most 

3-1 

two  "new"  sets,  each  containing  t = 2 = 4 classes.  The  procedure  is 
as  follows: 

1)  Using  the  first  "old"  set  s3(v): 

2 

From  eq.  4.37  the  "old"  set  contains  two  classes  S-j  -j  (v ) 

2 

and  S-j  2(v)  as  shown  in  the  second  column  of  Table  4.6a. 

The  first  class  links  the  two  nodes  Paa  and  Pcc  (Table  4.2a), 

2 

Table  4.6a:  v-symmetry  classes  at  A = 3.  [Starting  with  s-|(v)]. 


Previous  level  (A=2) 

Present  level  (A=3) 

m 

Classes 
of  "old" 
set 

Node 

pairs 

Vari ables 
w and  w' 

Classes  of  the  first 
"new"  set  s^(v): 

S3  -(v)  = {wa,w'c} 

1 

Classes  of  the  second 
"new"  set  s^v) 

So  -(v)={wb,w'd} 

* J 

1 

S1  ,l(v) 

x!,rPaa 

w=xi,i- 

S3  -j  (v)  = {Paaa  ,Pccc} 

S3  ^ (v)={Paab,Pccd) 

xi,rPcc 

w=xi,i » 

”,=x!,i 

S3  2(v)=(Pcca ,Paac} 

S3  2(v)={Pccb,Paad} 

S1,2(V) 

xj  2=^ca 

£ 

II 

To 

** 

w'=xi,2 

S3  3(v)={pcaa ,Pacc} 

S3  3(v)={Pcab,Pacd} 

2 

2 

x.|  2=Pac 

w"xl ,2’ 

w=x! ,2 

S3  ^(v)={Paca,Pcac) 

32  4(v)=^Pac^ >Pcad ) 
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while  the  second  links  the  two  nodes  Pea  and  Pac. 

1 2 1 
Therefore,  X|  ^ = Paa  » x]  •]  = Pcc  * xi  2 = Pcd 

2 

and  x-j  2 ~ Pac*  as  listed  in  the  third  column  of 
Table  4.6a.  The  fourth  column  of  the  table  lists 

I 

the  values  of  the  variables  w and  w as  they  are 
defined  in  eq.  4.3.  At  the  present  level  of  refine- 
ment X-  3,  there  are  at  most  two  "new"  sets--denoted 
as  sij(v)  and  s^v)  --  each  containing  four  classes 
which,  from  the  proposition  eqs.  4.11  and  4.13,  have 
the  general  forms: 

the  classes  of  the  s?(v):  S?  .(v)  = (wa ,w  c),  j=l,2,3,4 

' »J 

the  classes  of  the  sj^v):  j (v ) = (wb,w  d},  j=l  ,2,3,4 

I 

where  the  values  of  w and  w are  given  in  the  fourth 

column  of  Table  4.6a.  The  resulting  "new"  classes  at 

the  present  level  X=  3 are  given  in  the  fifth  and  sixth 

column  of  Table  4.6a.  Again,  like  in  the  h-symmetries , 

the  w takes  on  the  values  1 and  2. 

2)  Using  the  second  "old"  set  s^Cv): 

Again  from  eq.  4.37  the  "old"  set  contains  two  classes 
2 2 

i(v)  and  2(v)>  as  shown  in  the  second  column  of 
Table  4.6b.  The  first  class  links  the  two  nodes  Pab 
and  Pcd,  while  the  second  links  the  two  nodes  Pcb  and  Pad. 


(>9 


(4.44) 


Table  4.6b:  v-symmetry  classes  at  A=  3.  [Starting  with  s^( v) J . 


Previous  level  (\=2) 


Cl  asses 

m of  "old"  Node 
set  pairs 


Vari ables 
w and  w‘ 


Present  level  (\-3) 

Classes  of  the  first  Classes  of  the  second 
"new"  set  s3(v):  "new"  set  s|(v): 

S.  .(v)={wa,w' c}  S"  •(v)={wb,w'd} 

3 » J ^ » J 


x2,rPab 
x2,rPcd  w=x2 , 1 ’ W'  = X2,1 


9 xl  9=Pcb  w=xl  9,  w'=x 

2 s;  9(v)  , .. 

2 2 1 
x 2 2=Pad  w=x2  2’  w =x2  2 


S3  ^ (v)={Paba,Pcdc}  1 (v)={Pabb,Pcdd} 


S3  2(v)={Pcda,Pabc}  sj  2(v)={Pcdb,Pabd} 


S3  3(v)=(Pcba,Padc}  S4  3(v)={PCbb,Padd} 


S^  4(v)={Pada,Pcbc}  sj  4(v)={Padb,Pcbd) 


Therefore,  x0  1 = Pab,  x2  ^ = Pcd,  x2  2 = Pcb,  and 
2 

x „ = Pad,  as  listed  in  the  third  column  of  Table  4.6b. 

c # c 

l 

The  variables  w and  w are  defined  from  eq.  4.3  and  have 
the  values  listed  in  the  fourth  column  of  the  table. 

The  two  "new"  sets  of  the  present  level  A=  3 are  denoted 
as  s3(v)  and  s4(v),  and  each  contains  four  classes  whose 
general  forms  are  as  in  eq.  4.44  above.  These  classes 
are  shown  in  the  fifth  and  sixth  columns  of  Table  4.6b. 


3)  Using  the  third  "old"  set  s3(v): 

0 

Again,  the  "old"  set  contains  two  classes  S3  ^(v)  and 

p 

S3  2(v)  as  shown  in  the  second  column  of  Table  4.6c. 

The  first  class  links  the  two  nodes  Pba  and  Pdc,  while  the 

second  links  the  two  nodes  Pda  and  Pbc  (Table  4.2b). 

12  1 2 
Therefore,  x,  , = Pba,  x,  , = Pdc,  x.,  „ = Pda  and  x,  „ = P 


t 


Table  4.6c:  v- symmetry  classes  at  A = 3.  [Starting  with  s^(v). 


Previous  level  (A=2) 


Classes 

m of  "old"  Node 
set  nairs 


2 S3j2(v)  - 


x3,2“Pda 


X3 ,2~PbC 


Variables 
w and  w' 


Present  level  (A  = 3) 

Classes  of  the  first  Classes  of  the  second 
"new"  set  Sg(v):  "new"  set  Sg(v): 

Sr  ,(v)={wa,w'c}  S3  .(v)={wb,w'd} 

3 * J 0 > J 


w=x3 ,1 ' W'=X3,1 

S3  -j(v)={Pbaa,Pdcc} 

S3  , (v}={Pbab,Pdcd) 
0 , l 

w=x3,l * W'  X3 , 1 

S3  ?(v )={Pdca,Pbac} 

S3  2(v)={Pdcb,Pbad} 

w=x3,2*  W'=X3,2 

S53  (v  ) = {Pdaa,Pbcc} 

S3  ,(v ) = { P dab ,Pbcd) 

0 , J 

w=x3 ,2 ’ W'=X3,2 

— 
S5  4^v )={pbca,Pdac} 

S3)4(v)=(Pbcb,Pdad} 

as  listed  in  the  third  column  of  Table  4.6c.  The  two 

"new"  sets  of  the  present  level  A = 3 are  denoted  as 
3 3 

Sg(v)  and  Sg(v),  and  each  contains  four  classes  whose 
general  forms  are  again  as  in  eq.  4.44  above.  These 
classes  are  shown  in  the  fifth  and  sixth  columns  of 
Table  4.6c. 

4)  Using  the  fourth  "old"  set  s£(v): 

p 

Again,  the  "old"  set  contains  two  classes  ^ (v ) and 
2 

S4  2(v).  first  class  links  the  two  nodes  Pbb  and 

Pdd,  while  the  second  links  the  two  nodes  Pdb  and  Pbd 

(Table  4.2b).  Therefore,  x^  1 = Pbb,  x^  j = Pdd,  x^  2 
2 

and  x^  ^ ~ Pbd>  as  listed  in  the  third  column  of  Table 
4.6d  below.  The  two  "new"  sets  of  the  present  level  A 


Table 


Classes 
of  "old" 
set 


^4>2(v) 


t A = 3.  1 Starting  with  s^(v)], 

Present  level  (X=3) 


Classes  of  the  first 
"new"  set  s^(v): 

Classes  of  the  second 
"new"  set  Sg(v  ) : 

Sy  .(v)={wa,w' c) 

.(v)={wb,w‘d} 

Sy  -j  ( v)={Pbba  ,Pddc} 

Sg  1(v)={Pbbb,Pddd} 

2(v)={Pdda,Pbbc) 

Sg  2(v)={Pddb,Pbbd} 

3(v)={Pdba,Pbdc) 

Sg  3(v)={Pdbb,Pbdd} 

S7  4(v)  = {Pbda .Pdbc'1 

S8,4(vHPbdb,Pdbd} 

0 

are  denoted  as  s^(v)  and  Sg(v),  and  each  contains  four 
classes  whose  general  forms  are  again  as  in  eq.  4.44 
above.  These  classes  are  shown  in  the  fifth  and  sixth 
columns  of  Table  4.6d. 

Thus,  for  the  v-symmetries  at  level  3,  we  have  the  following  eight 
sets  of  classes: 

*?(v)  =(Sg(v),  S^2(v),  s?,3(v)’  Sl,4(v)} 

s|(v)  - ( Sgj  (v)  * S2,2(v)’  S2,3(v)’  S2,4(v)} 

s3(v)  ={S3,l(v)’  S3,2(v)’  S3,3(v)>  S3,4(v)} 

^3/  \ _ f c3  /.  \ c3  / \ c3  c3  / a a r- ' 


sj(v)  «{s;#1(v),  sj#2(v),  sj#3(v),  s^4(v)} 

S5(v)  = {S5,l(v)’  S5,2(v)’  S5,3(v)’  S5.4(v)} 

s6^  = S 6 , 1 ^ V ^ ’ S6,2^’  S6,3^v  ^ ’ S6,4^v^ 
sj(v)  * { Sy  j (v) . S^2(v),  S^3(v),  S^4(v)} 

Vv'  " (s8j(v)»  Sg  2(v).  S8,3^v^’  S8,4^v  ^ 


(4.45) 


Equation  4.45  is  the  same  as  eq.  3.13  of  the  previous  Section  3. 
The  classes  in  eq.  4.45  are  as  defined  in  Tables  4.6a,  4.6b,  4.6c  and 
4.6d,  and  they  are  the  same  as  in  eq.  3.12. 

4 . 3 . 3 . 3 £-symmet_ri  es 

From  eq.  4.39  we  see  that  at  the  previous  level  X = 2,  there  were 
2 2 2 

three  different  sets  s^(r),  s^r)  and  Sj(r).  Therefore,  our  procedure 
is  now  subdivided  into  three  parts,  one  for  the  classes  of  each  of  the 
above  three  sets. 

1)  Using  the  first  "old"  set  s^(r): 

o 

From  eq.  4.39  the  "old"  set  contains  two  classes  S-|  -|(r)  and 
2 

2(r)  as  shown  in  the  second  column  of  Table  4.7a.  The  first 
class  links  the  two  nodes  Pbb  and  Pcc,  while  the  second  links 

the  two  nodes  Pcb  and  Pbc  (Table  4.3).  Therefore,  xj  = Pbb, 

2 1 2 
x-j  1 = Pcc,  x-|  2 = Pck  dnci  X1  2 = Pbc’  as  '*1'stec*  t^ie 

column  of  Table  4.7a.  The  fourth  column  of  the  table  lists 

l 

the  values  of  the  variable  w and  w . At  the  present  level  of 

refinement  A = 3,  there  are  at  most  three  "new"  sets,  denoted 
3 3 3 

as  s-|(r),  S2(r)  and  s3(r).  The  number  of  classes  that  each 
new  set  contains  was  derived  in  paragraph  3.4.4.  In  this  case, 
the  first  new  set  contains  four  classes,  while  the  other  two 
new  sets  each  contain  two  classes.  From  eqs.  4.15,  4.17  and 
4.19  of  the  proposition,  the  classes  of  the  respective  three 
new  sets  have  the  following  forms: 
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Table  4.7a:  r-symmetry  classes  at  A = 3.  I Starting  with  s ^ ( r ) 1 . 


Previous  level  (*=2) 

Present  level  (>=3) 

r 

m 

Classes 
of  "old' 
set 

Node 
pai  rs 

Variables 
w and  w' 

Classes,  of  the  first 
"new"  set  sj(r): 

S3  j(r)={wb,w'ci 

Classes  of  the  second 
new"  set  s2(r): 

S3  .(r)  = {wa,w'a) 

Classes  of  the  third 
"new"  set  Sj(r): 

S3  r)  = (wd.w'dj 

i 

xj  ^Pbb 
2 

X^  ^=PCC 

~ 1 , 2 
w=xl .1 ’ w X1  ,1 

S3  1(r)={Pbbb,Pccc) 

S23  1(r)  = {Pbba,Pcca  ■ 

S3  ^rJsiPbbd.Pccdj 

2 , 1 

w~xl  ,1  ’ w 'X1  ,1 

S3  2(r)={Pccb,Pbbc} 

2 



S1.2<r> 

1 

x^  2=Pcb 
x^  2=Pbc 

1 , 2 
w~xl ,2’  w =X1 ,2 

S3  3(  r ) = { Pcbb  ,Pbcc> 

S3  2(r)={Pcba,Pbca) 

S3  2(r)=<Pcbd,Pbcd) 

2 , 1 
w=x^  2*  w =x-|  2 

S3  4(r)={Pbcb,Pcbc) 

3 3 1 

the  classes  of  the  s,(r):  S,  .(r)  = {wb,w  c} , j=l,2,3,4 

* >J 

3 3 * 

the  classes  of  the  s„(r):  S9  .(r)  = (wa,w  a),  j=l,2  (4. 

the  classes  of  the  s^r):  j ( r ) = (wd,w  dl,  j = l ,2 

The  resulting  "new"  classes  at  the  present  level  A = 3, 
are  given  in  the  fifth,  sixth  and  seventh  columns  of  Table 
4.7a. 

2)  Using  the  second  "old"  set  s^r): 

From  eq.  4.39  we  see  that  at  the  previous  level  A = 2,  the 

2 

"old"  set  contains  only  one  class  -|(r)  which,  from 

Table  4.3,  links  the  two  nodes  Pba  and  Pea.  Therefore, 

1 2 

i = Pba  and  Xp  ^ = Pea,  as  shown  in  the  third  column  of 
Table  4.7b.  At  this  present  level  of  refinement  A = 3, 


2 

Table  4.7b:  r-symmetry  classes  at  X = 3.  [Starting  with  s^Cr)]. 


Previous  level  ( \=2 ) 

Present  level  (X*3) 

~ 

m 

Classes 
of  "old" 
*et 

Node 

pairs 

' 1 

Variables 
w and  w' 

Classes  of  the  first 
"new"  set  si(r): 

j(  r)  = lwb,w‘ 1 1 

Classes  of  the  second 
"new"  set  Sj(r): 

^(r)=lwa,w'a) 

Classes  of  the  third 
""ew"  set  Sg( r) : 

S?  JrHwd.w'd) 

_=1 

S2,l<r> 



x1,  ,=Pba 

L.  y 1 

“ .2 

w ~ x j i w -*2  i 

S3  , (r)-(Pbab,Pcac! 

Sb3  j (r)=iPbaa ,Pcaai 

S3  j ( r)= (Pbad.Pcad; 

i 

U 

9 

*2  j ~Pcd 

x ^ 1 1 w — x 2 j 

S4  2(r)={Pcab,Pbac! 

3 

there  are  at  most  three  "new"  sets,  denoted  as  s^(r), 

3 3 

Sg(r),  and  sj:(r).  The  first  new  set  contains  two  classes, 
while  the  other  two  new  sets  each  contain  only  one  class, 
whose  general  forms  are  as  in  eq.  4.46  above.  These  classes 
are  listed  in  the  fifth,  sixth  and  seventh  columns  of 
Table  4.7b. 

3)  Using  the  third  "old"  set  Sg(r): 

2 

From  eq.  4.39,  the  "old"  set  contains  only  one  class  -j  ( r ) 

which,  from  Table  4.3,  links  the  two  nodes  Pbd  and  Pcd. 

1 2 

Therefore,  x^  ^ = Pbd  and  -j  = Pcd  as  shown  in  the  third 
column  of  Table  4.7c.  At  the  present  level  of  refinement 
X = 3,  there  are  again  at  most  three  "new"  sets,  denoted  as 
Sy(r),  Sg(r)  and  Sg(r).  The  first  new  set  contains  two  classes, 
while  the  other  two  each  contain  only  one  class,  whose  general 
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forms  are  as  in  eq.  4.46  above.  These  classes  are  listed 
in  the  fifth,  sixth  and  seventh  columns  of  Table  4.7c. 

Thus,  for  the  r-symmetries  at  level  3,  we  have  the  following  nine 
sets  of  classes: 

sl(r)  = {Sl,1(r)’  Sl,2(r)’  Sl,3(r)’  Sl,4(r)} 
s|(r)  = {S2,l(r)>  S2,2(r)} 
s^r)  = ^^(r),  s| ^2(r ) } 

sj(r)  = {S^(r),  sj^r)} 

s5(r)  = {S5,l(r)} 

S6(r)  = {S6,l(r)} 


(4.47) 


9 


i 


♦ 


I 


* 


m 


Equation  4.47  is  the  same  as  eq.  3.20  of  the  previous  Section  3. 
The  classes  in  eq.  4.47  are  as  defined  in  Tables  4.7a,  4.7b  and  4.7c, 
and  they  are  the  same  as  in  eq.  3.19. 

4. 3. 3.4  symme  t n es 

From  eq.  4.41  we  see  that  at  the  previous  level  A = 2,  there  were 
2 2 2 

three  different  sets  s^U),  and  s^Jl).  Therefore,  our  procedure 

is  again  subdivided  into  three  parts,  one  for  the  classes  of  each  of 
the  above  three  sets. 

1)  Using  the  first  "old"  set  s^U): 

p 

From  eq.  4.41  the  "old"  set  contains  two  classes  S-j  ■](£) 

2 

and  $i  as  shown  in  the  second  column  of  Table  4.8a. 

The  first  class  links  the  two  nodes  Paa  and  Pdd,  while 

the  second  links  the  two  nodes  Pda  and  Pad  (Table  4.4). 

12  1 2 
Therefore,  x-j  ^ = Paa,  x-|  -j  = Pdd,  x-|  ^ = Pda  and  x-j  ^ = Pad, 

as  listed  in  the  third  column  of  Table  4.8a.  At  the 
present  level  of  refinement  A = 3,  there  are  at  most  three 
"new"  sets,  denoted  as  s-j  (£ ) , s^U)  and  s^U).  The  number 
of  classes  that  each  new  set  contains  was  derived  in  para- 
graph 3.5.4.  In  this  case,  the  first  new  set  contains 
four  classes,  while  the  other  two  new  sets,  each  contain 
two  classes.  From  eqs.  4.21,  4.23  and  4.25  of  the  proposi- 
tion, the  classes  of  the  respective  three  new  sets  have  the 
following  forms: 
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Starting  with  sfU)] 


Classes  of  the  third 
"new"  set  sJ(£): 


S,  ,(£.)=  fPaaa ,Pddd} 


(£)={Paab,Pddb) 


(8.)=fPdda,Paad} 


U)  = tPdaa,Padd) 


(i)<=iPdac,Padc( 


(t)={Pada,Pdad} 


The  resulting  "new"  classes  at  the  present  level  X = 3 


are  listed  in  the  fifth,  sixth,  and  seventh  columns  of 


Table  4.3a 


2)  Using  the  second  "old"  set 

From  eq.  4.41  we  see  that  the  "old"  set  contains  only  one 

p 

class  S,  ,(#.)  which,  from  Table  4.4,  links  the  two  nodes 


Pab  and  Pdb.  Therefore,  x 


shown  in  the  third  column  of  Table  4.8b.  At  this  present 


t 


I 

I 

! 


# 


» 


o 

Table  4.8b:  ^-symmetry  classes  at  A = 3.  [Starting  with  stU)]* 


Previous  level  ( X=2 ) 

Present  level  ( X=  3) 

m 

Classes 
of  "old" 
set 

Node 

pairs 

Variables 
w and  w' 

Classes  of  the  first 
"new"  set  s|U) : 

S4  j(4)={wa,w'd} 

Classes  of  the  second 
"new"  set  s^( it ) : 

S5  j(1)=lwb,w'b) 

Classes  of  the  third 
"new"  set  s l{l) : 

S6  j ( *•) = ^wc .w ' c> 

_?  , „ 

*2  i=Pab 

w=x2  1 , w1 =x2  ^ 

S4  1(l)={Paba,Pdbdl 

Sjj  1{£)={Pabb.Pdbb) 

S63  ^ (£)  = {Pabc,Pdbc) 

1 

s2i)(0 

x2  ,=Pdb 

2 , 1 
w=X£  1 , w -^2  1 

S4  2UHPdba,Pabdj 

level  of  refinement  A = 3,  there  are  at  most  three  "new" 

3 3 3 

sets,  denoted  as  s^U),  s5(n)  and  SgU).  The  first  new 
set  contains  two  classes,  while  the  other  two  new  sets 
each  contain  only  one  class,  whose  general  forms  are  as  in 
eq.  4.48  above.  These  classes  are  listed  in  the  fifth, 
sixth,  and  seventh  columns  of  Table  4.8b. 

3)  Using  the  third  "old"  set  s^U): 

From  eq.  4.41,  the  "old"  set  contains  only  one  class 

1 ( } which,  from  Table  4.4,  links  the  two  nodes  Pac 
1 2 

and  Pdc.  Therefore,  x3  ^ = Pac  and  x3  ^ = Pdc  as  shown 

in  the  third  column  of  Table  4.8c.  At  the  present  level  j 

A = 3,  there  are  again  at  most  three  "new"  sets,  denoted 
3 3 3 

as  SyU),  Sg(2.)  and  Sg(£).  The  first  new  set  contains 
two  classes  and,  each  of  the  other  two,  one  class,  whose 
general  forms  are  as  in  eq.  4.46  above.  These  classes 
are  listed  in  the  fifth,  sixth  and  seventh  columns  of 
Table  4.8c. 
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Table  4.8c:  f- symmetry  classes  at  A = 3.  I Starting  with  s^U)  I. 


Previous  level  ( X= 2 ) 


Present  level  (t=3) 


m 

Classes 
of  "old” 
set 

Node 

pairs 

Variables 
w and  w' 

Classes  of  the  first 
"new”  set  s y ( £ ) : 

.(l)*(wa,w'd) 

Classes  of  the  second 
'new”  set  Sg( £ ) : 

S i .(S.)  = {wb,w’b) 
o>  J 

Classes  of  the  third 
"new"  set  SgU): 

S 1 .(l)*{wc,w‘c} 

c2  , X 

^=Pac 

1 , 2 

W*X3,T  W ”*3 ,1 

jU)  = (Paca,Pdcdl 

Sg  ,(l)*{Pacb,Pdcb) 

Sg  ,U)={Pacc,Pdcc} 

1 

s3>,U) 

x3  i'pdc 

2 , 1 
wx3 ,1  ’ w " 3,1 

2(|i)'fPtica',,acd^ 



Thus,  for  the  Jl-symmetries  at  level  A = 3,  we  have  the  following  nine 
sets  of  classes: 

sJ(A)  = (S^U),  S^2(&),  sJj3(£),  S^4U)} 

sf(»)  = {s|tl(i),  S^2U)} 

S3U)  = {S3,1(£)’  S3,2(<1)} 

sj(£)  = {s^  }U),  ^ 2(n)} 

, ’ * (4.49) 

sgU)  = {S5,1 (£)} 

S6U)  = (S6J  (£)^ 

S7U)  = (s^U),  s^2U)} 

SgU)  = {S8,1(£)} 

s|(a)  = {S^U)} 


Equation  4.49  is  the  same  as  eq.  3.26  of  the  previous  Section  3. 
The  classes  in  eq.  4.49  are  as  defined  in  Tables  4.8a,  4.8b  and  4.8c, 
and  they  are  the  same  as  in  eq.  3.25. 
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SECTION  5 

CONCLUSIONS  AND  FURTHER  WORK 

In  this  report  we  have  treated  the  general  problem  of  extracting 
structural  information  from  an  object  in  a scene. 

The  scene  is  first  decomposed  into  regions  (subgrids ), through 
the  application  of  the  regular  decomposition  procedure  described  in 
Section  2.  The  outcome  of  this  decomposition  is  a dimensionally 
reduced  tree  data-structure  where  only  the  "informative"  sections  of 
the  picture  have  been  retained.  Each  tree  node  represents  information 
about  a particular  zone  of  the  picture,  whose  (the  zone's)  size  and 
position  depend  upon  the  level  and  the  location  of  the  node  in  the 
tree.  We  have  identified  the  nodes  of  the  tree  data-structure  that 
correspond  to  picture  subgrids  at  various  directions, and  have  given 
their  interrelationships.  Only  four  directions  are  treated  in  this 
report,  i.e.,  horizontal,  vertical,  left-diagonal  and  right-diagonal 
(although  this  can  easily  be  extenued  to  include  other  directions, 
too),  and  we  have  proposed  a recursive  algorithm  which  specifies  the 
tree  nodes--i.e.,  picture  subregions  of  various  sizes--that  must  be 
paired  (or  compared)  to  identify  (or  extract)  possible  directional 
symmetries  present  in  the  picture.  This  proposition  has  been  tested 
on  various  symmetry  data-struct.ures  and  the  results--given  in  tabular 
form,  at  various  tree  levels,  for  each  of  the  four  directional  symme- 
tries--proved  to  be  valid. 

For  extensions  to  this  work  we  plan  to  cover  many  other  directional 
symmetries,  for  example,  directions  at  angles  of  15  apart.  Having 
done  this,  we  will  present  a complete  ALGOL-like  description  of  the 
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algorithm  and  results  obtained  by  applying  it  to  various  pictures  of 
both  artificial  and  real  scenes.  Included  in  these  experimental  runs 
we  propose  to:  (1)  perform  the  regular  decomposition  tree  data- 

structure  based  not  only  on  average  subgrid  intensity  but  also  on 
directional  symmetries;  (2)  incorporate  statistical  parameters  to  each 
tree  node,  thus  combining  (or  comparing)  them  to  identify  synmetries 
based  on  statistical  measurements;  (3)  perform  tree-mapping,  i.e., 
transform  one  tree  data-structure  to  anotner,  in  which  the  relation- 
ships between  di recti onal -symmetries  and  tree-nodes  will  be  explicitly 
s hown . 

Although  the  subgrid  sizes  and  shapes  are  fixed  in  this  report, 
we  can  readily  extend  the  method  to  include  variable  (and  adaptive) 
sizes  and  shapes  in  performing  our  data-structure  generation. 

Our  process  may  also  be  part  of  an  on-line  system  (or  picture- 
language)  where  the  complicated  object  to  be  "decomposed"  (fragmented, 
atomized)  is  identified  through  an  algorithm  which  operates  with 
guidance.  For  example,  the  operator  may  point  out  the  part  of  the 
image  that  he  proposes  to  the  machine.  The  algorithm  then  can  do  all 
the  necessary  decomposing  and  matching. 

Our  process  may  also  be  used  for  performing  a nonuniform  and 
adaptive  scan  of  the  picture.  Thus,  under  digital  control,  scene 
symmetries  may  be  located  by  using  a reflection  of  the  scan--a  dual 
scan--about  a "stepped"  test  symmetry-axis.  The  width  of  this  dual 
scan  may  also  be  adaptively  varying,  according  to  the  level  of  the 
desired  resolution  of  the  scanner. 

Finally,  we  believe  that  such  a hierarchical  decision  based  prob- 
lem subdivision  may  well  be  compactly  handled  by  formal  grammars. 


This  work  may  be  extended  as  follows: 

1.  Improve  the  regular  decomposition  algorithm  by  finding 
criteria  that  subdivide  a region  not  necessarily  in 
four  equal  parts,  but  in  a number  of  parts,  of  various 
sizes,  and  along  "directions  of  importance".  For 
example,  it  may  be  fruitful  to  partition  the  picture 
along  a certain  direction  where  a strong  symmetry  has 
been  identified. 

2.  Perform  a mapping  from  the  "regular  decomposition  tree" 
to  a "directional  symmetry  tree",  i.e.,  a tree  which 
explicitly  reflects  symmetries  present  in  the  picture. 

3.  Increase  the  number  of  directions  along  which  symmetries 
are  being  examined,  e.g.,  at  angles  of  15°,  and  get  the 
"symmetry  histograms"  of  real  scenes  or  objects  (i.e., 
"degree  of  symmetry"  vs.  "angle"). 

4.  Investigate  how  are  certain  patterns  directly  recognizable 
from  their  tree  structure. 

5.  Modify  the  algorithm  to  dynamically  (or,  maybe,  inter- 
actively) vary  subgrid  dimensions  and/or  shape,  so  that 
effectively  the  procedure  will  be  focusing  on  "interesting 
areas  of  the  picture. 

6.  We  plan  to  investigate  the  subquadrants'  spatial  and 
topological  relationships  (e.g.,  ACJACENT,  ABOVE,  etc.) 
with  regards  to  their  position  on  the  tree  representation 
of  the  image. 

7.  Simulation  of  adaptive  picture  scanning  to  locate  scene 
symmetries. 


8.  Investigate  efficient  data  structures  for  image  representa- 
tion and  processing,  so  that  parts  of  the  data  structure  can 
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